Jul 29 15:56:23 devstack cinder-volume[77279]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 29 15:56:23 devstack cinder-volume[77279]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 29 15:56:23 devstack cinder-volume[77279]: we strongly recommend against using it for new projects. Jul 29 15:56:23 devstack cinder-volume[77279]: If you are already using Eventlet, we recommend migrating to a different Jul 29 15:56:23 devstack cinder-volume[77279]: framework. For more detail see Jul 29 15:56:23 devstack cinder-volume[77279]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 29 15:56:23 devstack cinder-volume[77279]: import eventlet # noqa Jul 29 15:56:26 devstack cinder-volume[77279]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 15:56:26 devstack cinder-volume[77279]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 15:56:26 devstack cinder-volume[77279]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 15:56:27 devstack cinder-volume[77279]: INFO dbcounter [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Registered counter for database cinder Jul 29 15:56:27 devstack cinder-volume[77279]: DEBUG oslo_db.sqlalchemy.engines [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG dbcounter [-] [77279] Writer thread running {{(pid=77279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.rpc [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.rpc [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG oslo_db.sqlalchemy.engines [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.volume.manager [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Determined volume DB was empty at startup. Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG cinder.volume.manager [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77279) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.volume.manager [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 29 15:56:28 devstack cinder-volume[77279]: WARNING stevedore.named [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 29 15:56:28 devstack cinder-volume[77279]: WARNING castellan.key_manager [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 15:56:28 devstack cinder-volume[77279]: WARNING cinder.keymgr.conf_key_mgr [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG cinder.volume.drivers.lvm [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77279) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG oslo_concurrency.processutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG oslo_concurrency.processutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] CMD "cinder-rtstool verify" returned: 0 in 0.525s {{(pid=77279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG oslo_db.sqlalchemy.engines [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.rpc [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.rpc [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 29 15:56:28 devstack cinder-volume[77279]: WARNING stevedore.named [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 29 15:56:28 devstack cinder-volume[77279]: WARNING castellan.key_manager [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 15:56:28 devstack cinder-volume[77279]: INFO cinder.volume.manager [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 29 15:56:28 devstack cinder-volume[77279]: DEBUG oslo_db.sqlalchemy.engines [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 15:56:29 devstack cinder-volume[77279]: INFO oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Starting 1 workers Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Started child 77484 {{(pid=77279) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Full set of CONF: {{(pid=77279) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] ******************************************************************************** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Configuration options gathered from: {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] ================================================================================ {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] allow_availability_zone_fallback = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] allow_compression_on_image_upload = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] allowed_direct_url_schemes = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] api_rate_limit = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] auth_strategy = keystone {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] az_cache_duration = 3600 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_availability_zone = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_host = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_stats_polling_interval = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backup_api_class = cinder.backup.api.API {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77484]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.1) Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backup_name_template = backup-%s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backup_use_same_host = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backup_use_temp_snapshot = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] chap_password = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] chap_username = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_internal_tenant_project_id = 0d3ddaa662ae49f1925aeb7d6367c2bd {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_internal_tenant_user_id = 11c52eaa91d0496b99f8f70415722ce5 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cloned_volume_same_az = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cluster = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] compression_format = gzip {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] compute_api_class = cinder.compute.nova.API {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] config_dir = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] config_source = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] control_exchange = openstack {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] debug = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] default_availability_zone = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] default_group_type = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] default_volume_type = lvmdriver-1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] disk_geometry = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] driver_client_cert = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] driver_client_cert_key = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] driver_data_namespace = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] driver_ssl_cert_path = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] driver_ssl_cert_verify = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] driver_use_ssl = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] enable_force_upload = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] enable_new_services = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] enable_unsupported_driver = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] enabled_backends = ['lvmdriver-1'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] enforce_multipath_for_image_xfer = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] filter_function = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_api_insecure = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_api_servers = ['http://192.168.122.220/image'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_api_ssl_compression = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_ca_certificates_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_catalog_info = image:glance:publicURL {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_num_retries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance_request_timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] goodness_function = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] graceful_shutdown_timeout = 5 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] group_api_class = cinder.group.api.API {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] host = devstack {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_compress_on_upload = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_conversion_address_space_limit = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_conversion_cpu_limit = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_conversion_disable = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_upload_use_cinder_backend = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_upload_use_internal_tenant = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_volume_cache_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_volume_cache_max_count = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] image_volume_cache_max_size_gb = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] init_host_max_objects_retrieval = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] instance_format = [instance: %(uuid)s] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] iscsi_target_flags = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] iscsi_write_cache = on {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] iser_helper = tgtadm {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] iser_ip_address = 192.168.122.220 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] iser_port = 3260 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_color = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_config_append = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_dir = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_options = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_rotate_interval = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_rotate_interval_type = days {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] log_rotation_type = none {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] max_age = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] max_logfile_count = 30 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] max_logfile_size_mb = 200 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] max_over_subscription_ratio = 20.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] message_reap_interval = 86400 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] message_ttl = 2592000 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] migration_create_volume_timeout_secs = 300 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] monkey_patch = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] monkey_patch_modules = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] my_ip = 192.168.122.220 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] no_snapshot_gb_quota = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] num_iser_scan_tries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] num_shell_tries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] num_volume_device_scan_tries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] nvmeof_conn_info_version = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] nvmet_ns_id = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] nvmet_port_id = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_max_limit = 1000 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_volume_ext_list = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_volume_listen = 0.0.0.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_volume_listen_port = 8776 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_volume_use_ssl = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] osapi_volume_workers = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] per_volume_size_limit = -1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] periodic_fuzzy_delay = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] periodic_interval = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] project_id_regex = [0-9a-f\-]+ {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] public_endpoint = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] publish_errors = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_backup_gigabytes = 1000 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_backups = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_gigabytes = 1000 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_groups = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_snapshots = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] quota_volumes = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] rate_limit_burst = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] rate_limit_except_level = CRITICAL {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] rate_limit_interval = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] reinit_driver_count = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] replication_device = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] report_discard_supported = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] report_interval = 120 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] reservation_clean_interval = 86400 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] reservation_expire = 86400 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] reserved_image_namespaces = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] reserved_percentage = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] rpc_response_timeout = 120 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] run_external_periodic_tasks = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] scst_target_driver = iscsi {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] scst_target_iqn_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_down_time = 720 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] shell_completion = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] snapshot_name_template = snapshot-%s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] snapshot_same_host = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] split_loggers = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] state_path = /opt/stack/data/cinder {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] storage_availability_zone = nova {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] storage_protocol = iSCSI {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] syslog_log_facility = LOG_USER {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] target_helper = lioadm {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] target_ip_address = 192.168.122.220 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] target_port = 3260 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] target_protocol = iscsi {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] target_secondary_ip_addresses = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] trace_flags = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] transfer_api_class = cinder.transfer.api.API {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] transport_url = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] until_refresh = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_chap_auth = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_default_quota_class = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_journal = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_json = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_multipath_for_image_xfer = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_stderr = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] use_syslog = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] verify_glance_signatures = enabled {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_api_class = cinder.volume.api.API {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_backend_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_clear = zero {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_clear_ionice = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_clear_size = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_copy_bps_limit = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_dd_blocksize = 1M {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_name_template = volume-%s {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_service_inithost_offload = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77484]: INFO cinder.volume.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volume_usage_audit_period = month {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] zoning_mode = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_concurrency.disable_process_locking = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.auth_section = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.auth_type = password {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.auth_version = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.cache = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.delay_auth_decision = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.http_connect_timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.include_service_catalog = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.insecure = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.interface = public {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_password = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcache_username = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.region_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.service_token_roles_required = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.service_type = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.token_cache_time = 300 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.220/identity {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.backend = dogpile.cache.null {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.backend_argument = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.backend_expiration_time = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.config_prefix = cache.oslo {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.debug_cache_backend = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.enable_retry_client = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.enable_socket_keepalive = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.expiration_time = 600 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.hashclient_retry_attempts = 2 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_dead_retry = 300 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_pool_maxsize = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_sasl_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.password = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.proxies = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.redis_db = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.redis_sentinel_service_name = mymaster {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.redis_server = localhost:6379 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.retry_attempts = 2 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.retry_delay = 0.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.socket_keepalive_count = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.socket_keepalive_idle = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.socket_keepalive_interval = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.socket_timeout = 1.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.tls_allowed_ciphers = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.tls_cafile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.tls_certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.tls_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.tls_keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cache.username = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] coordination.backend_url = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.asyncio_connection = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.asyncio_slave_connection = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.backend = sqlalchemy {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.connection = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.connection_debug = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.connection_parameters = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.connection_recycle_time = 3600 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.connection_trace = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.db_inc_retry_interval = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.db_max_retries = 20 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.db_max_retry_interval = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.db_retry_interval = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.max_overflow = 50 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.max_pool_size = 5 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.max_retries = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.mysql_wsrep_sync_wait = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.pool_timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.retry_interval = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.slave_connection = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.sqlite_synchronous = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.synchronous_reader = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] database.use_db_reconnect = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.connection_string = messaging:// {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.es_doc_type = notification {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.es_scroll_size = 10000 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.es_scroll_time = 2m {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.filter_error_trace = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.hmac_keys = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.sentinel_service_name = mymaster {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.socket_timeout = 0.1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.trace_requests = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler.trace_sqlalchemy = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler_jaeger.process_tags = {} {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler_jaeger.service_name_prefix = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] profiler_otlp.service_name_prefix = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.enforce_new_defaults = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.policy_default_rule = default {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.policy_file = policy.yaml {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_policy.remote_timeout = 60.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.group = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.helper_command = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] privsep_osbrick.user = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.group = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.helper_command = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] cinder_sys_admin.user = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.auth_section = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.auth_type = password {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.cafile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.collect_timing = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.insecure = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.send_service_user_token = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.split_loggers = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] service_user.timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.auth_section = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.auth_type = password {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.collect_timing = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.insecure = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.region_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.split_loggers = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] glance.timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.backend_availability_zone = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.chap_password = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.chap_username = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.disk_geometry = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.driver_client_cert = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.driver_client_cert_key = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.driver_data_namespace = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.driver_use_ssl = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.enable_unsupported_driver = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.extra_capabilities = {} {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.filter_function = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.goodness_function = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.iscsi_target_flags = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.iscsi_write_cache = on {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.iser_helper = tgtadm {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.iser_ip_address = 192.168.122.220 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.iser_port = 3260 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.lvm_mirrors = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.lvm_share_target = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.lvm_type = auto {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.num_shell_tries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.nvmet_port_id = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.replication_device = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.report_discard_supported = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.reserved_percentage = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.scst_target_driver = iscsi {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.scst_target_iqn_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.storage_protocol = iSCSI {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.target_helper = tgtadm {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.target_ip_address = 192.168.122.220 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.target_port = 3260 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.target_protocol = iscsi {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.trace_flags = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.unique_fqdn_network = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.use_chap_auth = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_backend_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_clear = zero {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_clear_ionice = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_clear_size = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack sudo[77555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack sudo[77555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volume_group = cinder-volumes {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_reports.file_event_handler = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_reports.log_dir = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.backend_availability_zone = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.backend_host = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.chap_password = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.chap_username = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.chiscsi_conf = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.disk_geometry = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.driver_client_cert = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.driver_data_namespace = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.driver_use_ssl = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.extra_capabilities = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.filter_function = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.goodness_function = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.iser_helper = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.iser_ip_address = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.iser_port = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.iser_target_prefix = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.lvm_conf_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.lvm_mirrors = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.lvm_share_target = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.lvm_type = auto {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.num_shell_tries = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.nvmet_port_id = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.replication_device = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.report_discard_supported = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.reserved_percentage = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.scst_target_driver = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.storage_protocol = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.target_helper = lioadm {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.target_ip_address = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.target_port = 3260 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.target_protocol = iscsi {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.trace_flags = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.use_chap_auth = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_clear = zero {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_clear_size = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] lvmdriver-1.volumes_dir = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.ssl_version = {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_notifications.driver = [] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_notifications.retry = -1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] oslo_messaging_notifications.transport_url = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] key_manager.fixed_key = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.barbican_api_version = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.barbican_endpoint = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.barbican_endpoint_type = public {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.barbican_region_name = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.cafile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.collect_timing = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.insecure = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.number_of_retries = 60 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.retry_delay = 1 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.send_service_user_token = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.split_loggers = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.verify_ssl = True {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican.verify_ssl_path = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.auth_section = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.auth_type = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.cafile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.certfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.collect_timing = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.insecure = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.keyfile = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.split_loggers = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] barbican_service_user.timeout = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.approle_role_id = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.approle_secret_id = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.auth_method = approle {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.auth_path = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.kv_mountpoint = secret {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.kv_path = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.kv_version = 2 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.namespace = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.root_token_id = **** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.ssl_ca_crt_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.timeout = 60.0 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.token_file = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.token_role = None {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.use_ssl = False {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 15:56:29 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] ******************************************************************************** {{(pid=77279) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 29 15:56:29 devstack sudo[77555]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack sudo[77665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:29 devstack sudo[77665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:29 devstack sudo[77665]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.282s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 15:56:29 devstack cinder-volume[77484]: INFO cinder.brick.local_dev.lvm [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:29 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:29 devstack sudo[77753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:56:29 devstack sudo[77753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:30 devstack sudo[77753]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG cinder.brick.local_dev.lvm [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77484) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:30 devstack sudo[77853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:30 devstack sudo[77853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:30 devstack sudo[77853]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:30 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:30 devstack sudo[78089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:30 devstack sudo[78089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:31 devstack sudo[78089]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.365s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:31 devstack sudo[78099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 29 15:56:31 devstack sudo[78099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:31 devstack sudo[78099]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.354s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:31 devstack sudo[78182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:56:31 devstack sudo[78182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:31 devstack sudo[78182]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:31 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:31 devstack sudo[78185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:56:31 devstack sudo[78185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:32 devstack sudo[78185]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:32 devstack sudo[78229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:32 devstack sudo[78229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:32 devstack sudo[78229]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:32 devstack sudo[78277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:32 devstack sudo[78277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:32 devstack sudo[78277]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:32 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:32 devstack sudo[78281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:32 devstack sudo[78281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:33 devstack sudo[78281]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:33 devstack cinder-volume[77484]: INFO cinder.volume.drivers.lvm [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:33 devstack sudo[78285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:33 devstack sudo[78285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:33 devstack sudo[78285]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:33 devstack sudo[78288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:56:33 devstack sudo[78288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:33 devstack sudo[78288]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:33 devstack sudo[78291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:33 devstack sudo[78291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:33 devstack sudo[78291]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:33 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:33 devstack sudo[78300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:33 devstack sudo[78300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:34 devstack sudo[78300]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:34 devstack sudo[78303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:34 devstack sudo[78303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:34 devstack sudo[78303]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:34 devstack cinder-volume[77484]: INFO cinder.volume.driver [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Driver hasn't implemented _init_vendor_properties() Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG cinder.volume.driver [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77484) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_db.sqlalchemy.engines [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writer thread running {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG cinder.db.sqlalchemy.api [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Building query based on filter {{(pid=77484) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG cinder.image.image_utils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77484) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 29 15:56:34 devstack cinder-volume[77484]: INFO cinder.keymgr.migration [None req-37ddd788-99d5-4ea3-8f7f-32b5e0a87585 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:34 devstack sudo[78308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:56:34 devstack sudo[78308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:34 devstack sudo[78308]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:34 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:34 devstack sudo[78311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:34 devstack sudo[78311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:35 devstack sudo[78311]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:35 devstack sudo[78314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:35 devstack sudo[78314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:35 devstack sudo[78314]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:35 devstack sudo[78318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:35 devstack sudo[78318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:35 devstack sudo[78318]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG cinder.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Notifying Schedulers of capabilities ... {{(pid=77484) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 15:56:35 devstack cinder-volume[77484]: INFO cinder.volume.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Driver initialization completed successfully. Jul 29 15:56:35 devstack cinder-volume[77484]: INFO cinder.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Initiating service 2 cleanup Jul 29 15:56:35 devstack cinder-volume[77484]: INFO cinder.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Service 2 cleanup completed. Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG cinder.service [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Creating RPC server for service cinder-volume {{(pid=77484) start /opt/stack/cinder/cinder/service.py:231}} Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG cinder.service [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77484) start /opt/stack/cinder/cinder/service.py:237}} Jul 29 15:56:35 devstack cinder-volume[77484]: INFO cinder.volume.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 15:56:35 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:35 devstack sudo[78322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:56:35 devstack sudo[78322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:36 devstack sudo[78322]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:36 devstack sudo[78326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:36 devstack sudo[78326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:36 devstack sudo[78326]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:36 devstack sudo[78329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:56:36 devstack sudo[78329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:36 devstack sudo[78329]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:56:36 devstack sudo[78333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:56:36 devstack sudo[78333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:56:36 devstack sudo[78333]: pam_unix(sudo:session): session closed for user root Jul 29 15:56:36 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:56:37 devstack cinder-volume[77484]: INFO cinder.volume.manager [None req-32e49f59-2ff4-4b39-8f4c-520903d6a5da None None] Driver post RPC initialization completed successfully. Jul 29 15:56:39 devstack cinder-volume[77279]: DEBUG dbcounter [-] [77279] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 15:56:47 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 15:56:47 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_service.periodic_task [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77484) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:57:49 devstack sudo[80413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:57:49 devstack sudo[80413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:57:49 devstack sudo[80413]: pam_unix(sudo:session): session closed for user root Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:57:49 devstack sudo[80416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:57:49 devstack sudo[80416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:57:49 devstack sudo[80416]: pam_unix(sudo:session): session closed for user root Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:57:49 devstack sudo[80419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:57:49 devstack sudo[80419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:57:49 devstack sudo[80419]: pam_unix(sudo:session): session closed for user root Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:57:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:57:49 devstack sudo[80435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:57:49 devstack sudo[80435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:57:50 devstack sudo[80435]: pam_unix(sudo:session): session closed for user root Jul 29 15:57:50 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:57:50 devstack cinder-volume[77484]: DEBUG cinder.manager [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Notifying Schedulers of capabilities ... {{(pid=77484) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 15:58:47 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writing DB stats cinder:SELECT=1 {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 15:58:47 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writing DB stats cinder:UPDATE=1 {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_service.periodic_task [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77484) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:58:49 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:58:49 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:58:49 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:58:49 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:58:49 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:58:49 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:58:49 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:58:49 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:58:49 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:58:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:58:49 devstack sudo[83790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:58:49 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:58:50 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root Jul 29 15:58:50 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:58:50 devstack cinder-volume[77484]: DEBUG cinder.manager [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Notifying Schedulers of capabilities ... {{(pid=77484) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_service.periodic_task [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77484) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:59:49 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 15:59:49 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:59:49 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:59:49 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:59:49 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:59:49 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:59:49 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 15:59:49 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:59:49 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:59:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 15:59:49 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 15:59:49 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 15:59:50 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Jul 29 15:59:50 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 15:59:50 devstack cinder-volume[77484]: DEBUG cinder.manager [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Notifying Schedulers of capabilities ... {{(pid=77484) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:00:47 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writing DB stats cinder:SELECT=1 {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:00:47 devstack cinder-volume[77484]: DEBUG dbcounter [-] [77484] Writing DB stats cinder:UPDATE=1 {{(pid=77484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_service.periodic_task [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77484) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG cinder.volume.drivers.lvm [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Updating volume stats {{(pid=77484) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:00:49 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 29 16:00:49 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:00:49 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:00:49 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 16:00:49 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:00:49 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:00:49 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 29 16:00:49 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:00:49 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:00:49 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:00:49 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 29 16:00:49 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:00:50 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Jul 29 16:00:50 devstack cinder-volume[77484]: DEBUG oslo_concurrency.processutils [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77484) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:00:50 devstack cinder-volume[77484]: DEBUG cinder.manager [None req-e9df4c20-57aa-44c5-a384-5d209674b883 None None] Notifying Schedulers of capabilities ... {{(pid=77484) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:01:13 devstack cinder-volume[77279]: INFO oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Caught SIGTERM, stopping children Jul 29 16:01:13 devstack cinder-volume[77279]: DEBUG oslo_concurrency.lockutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Acquiring lock "singleton_lock" {{(pid=77279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 16:01:13 devstack cinder-volume[77279]: DEBUG oslo_concurrency.lockutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Acquired lock "singleton_lock" {{(pid=77279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 16:01:13 devstack cinder-volume[77279]: DEBUG oslo_concurrency.lockutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Releasing lock "singleton_lock" {{(pid=77279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 16:01:13 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Stop services. {{(pid=77279) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 29 16:01:13 devstack cinder-volume[77279]: DEBUG oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Killing children. {{(pid=77279) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 29 16:01:13 devstack cinder-volume[77279]: INFO oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Waiting on 1 children to exit Jul 29 16:01:15 devstack cinder-volume[77484]: DEBUG oslo_concurrency.lockutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Acquiring lock "singleton_lock" {{(pid=77484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 16:01:15 devstack cinder-volume[77484]: DEBUG oslo_concurrency.lockutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Acquired lock "singleton_lock" {{(pid=77484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 16:01:15 devstack cinder-volume[77484]: DEBUG oslo_concurrency.lockutils [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Releasing lock "singleton_lock" {{(pid=77484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 16:01:15 devstack cinder-volume[77484]: WARNING amqp [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 29 16:01:15 devstack cinder-volume[77484]: WARNING amqp [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 29 16:01:15 devstack cinder-volume[77279]: INFO oslo_service.backend._eventlet.service [None req-e5177086-f242-4bb9-9b9b-d071b0cd8fbb None None] Child 77484 exited with status 0 Jul 29 16:01:16 devstack cinder-volume[87628]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 29 16:01:16 devstack cinder-volume[87628]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 29 16:01:16 devstack cinder-volume[87628]: we strongly recommend against using it for new projects. Jul 29 16:01:16 devstack cinder-volume[87628]: If you are already using Eventlet, we recommend migrating to a different Jul 29 16:01:16 devstack cinder-volume[87628]: framework. For more detail see Jul 29 16:01:16 devstack cinder-volume[87628]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 29 16:01:16 devstack cinder-volume[87628]: import eventlet # noqa Jul 29 16:01:18 devstack cinder-volume[87628]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 16:01:18 devstack cinder-volume[87628]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 16:01:18 devstack cinder-volume[87628]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 16:01:19 devstack cinder-volume[87628]: INFO dbcounter [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Registered counter for database cinder Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_db.sqlalchemy.engines [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG dbcounter [-] [87628] Writer thread running {{(pid=87628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 29 16:01:19 devstack cinder-volume[87628]: INFO cinder.rpc [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 29 16:01:19 devstack cinder-volume[87628]: INFO cinder.rpc [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_db.sqlalchemy.engines [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:19 devstack cinder-volume[87628]: INFO cinder.volume.manager [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Determined volume DB was empty at startup. Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG cinder.volume.manager [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87628) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 29 16:01:19 devstack cinder-volume[87628]: INFO cinder.volume.manager [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 29 16:01:19 devstack cinder-volume[87628]: WARNING stevedore.named [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 29 16:01:19 devstack cinder-volume[87628]: WARNING castellan.key_manager [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 16:01:19 devstack cinder-volume[87628]: WARNING cinder.keymgr.conf_key_mgr [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 16:01:19 devstack cinder-volume[87628]: INFO cinder.volume.manager [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_db.sqlalchemy.engines [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:19 devstack cinder-volume[87628]: INFO oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Starting 1 workers Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Started child 87901 {{(pid=87628) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Full set of CONF: {{(pid=87628) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] ******************************************************************************** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Configuration options gathered from: {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] ================================================================================ {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] allow_availability_zone_fallback = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] allow_compression_on_image_upload = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] allowed_direct_url_schemes = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] api_rate_limit = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87901]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.1) Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] auth_strategy = keystone {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_availability_zone = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_host = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_stats_polling_interval = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backup_api_class = cinder.backup.api.API {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backup_name_template = backup-%s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backup_use_same_host = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backup_use_temp_snapshot = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] chap_password = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] chap_username = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_internal_tenant_project_id = 0d3ddaa662ae49f1925aeb7d6367c2bd {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_internal_tenant_user_id = 11c52eaa91d0496b99f8f70415722ce5 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cluster = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] compression_format = gzip {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] compute_api_class = cinder.compute.nova.API {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] config_dir = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] config_source = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] control_exchange = openstack {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] debug = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] default_availability_zone = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] default_group_type = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] default_volume_type = QuobyteHD {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] disk_geometry = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] driver_client_cert = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] driver_client_cert_key = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] driver_data_namespace = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] driver_ssl_cert_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] driver_ssl_cert_verify = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] driver_use_ssl = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] enable_new_services = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] enable_unsupported_driver = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] enabled_backends = ['QuobyteHD'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] enforce_multipath_for_image_xfer = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] filter_function = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_api_insecure = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_api_servers = ['http://192.168.122.220/image'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_api_ssl_compression = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_ca_certificates_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_catalog_info = image:glance:publicURL {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_num_retries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance_request_timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] goodness_function = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] graceful_shutdown_timeout = 5 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] group_api_class = cinder.group.api.API {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] host = devstack {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_compress_on_upload = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_conversion_address_space_limit = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_conversion_cpu_limit = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_conversion_disable = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_upload_use_cinder_backend = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_upload_use_internal_tenant = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_volume_cache_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_volume_cache_max_count = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] image_volume_cache_max_size_gb = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] init_host_max_objects_retrieval = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] instance_format = [instance: %(uuid)s] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] iscsi_target_flags = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] iscsi_write_cache = on {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] iser_helper = tgtadm {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] iser_ip_address = 192.168.122.220 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] iser_port = 3260 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_color = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_config_append = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_dir = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_options = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_rotate_interval = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_rotate_interval_type = days {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] log_rotation_type = none {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] max_age = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] max_logfile_count = 30 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] max_logfile_size_mb = 200 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] max_over_subscription_ratio = 20.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] message_reap_interval = 86400 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] message_ttl = 2592000 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] migration_create_volume_timeout_secs = 300 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] monkey_patch = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] monkey_patch_modules = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] my_ip = 192.168.122.220 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] no_snapshot_gb_quota = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] num_iser_scan_tries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] num_shell_tries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] num_volume_device_scan_tries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] nvmeof_conn_info_version = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] nvmet_ns_id = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] nvmet_port_id = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_max_limit = 1000 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_volume_ext_list = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_volume_listen_port = 8776 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_volume_use_ssl = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] osapi_volume_workers = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] per_volume_size_limit = -1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] periodic_fuzzy_delay = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] periodic_interval = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] public_endpoint = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] publish_errors = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_backup_gigabytes = 1000 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_backups = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_gigabytes = 1000 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_groups = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_snapshots = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] quota_volumes = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] rate_limit_burst = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] rate_limit_except_level = CRITICAL {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] rate_limit_interval = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] reinit_driver_count = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] replication_device = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] report_discard_supported = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] report_interval = 120 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] reservation_clean_interval = 86400 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] reservation_expire = 86400 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] reserved_image_namespaces = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] reserved_percentage = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] rpc_response_timeout = 120 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] run_external_periodic_tasks = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] scst_target_driver = iscsi {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] scst_target_iqn_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_down_time = 720 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] shell_completion = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] snapshot_name_template = snapshot-%s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] split_loggers = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] state_path = /opt/stack/data/cinder {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] storage_availability_zone = nova {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] storage_protocol = iSCSI {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] syslog_log_facility = LOG_USER {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] target_helper = lioadm {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] target_ip_address = 192.168.122.220 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] target_port = 3260 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] target_protocol = iscsi {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87901]: INFO cinder.volume.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Starting volume driver QuobyteDriver (1.2) Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] target_secondary_ip_addresses = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.remotefs [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87901) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] trace_flags = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] transport_url = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] until_refresh = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_chap_auth = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_default_quota_class = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_journal = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_json = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_multipath_for_image_xfer = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_stderr = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] use_syslog = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] verify_glance_signatures = enabled {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_api_class = cinder.volume.api.API {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_backend_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_clear = zero {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_clear_ionice = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_clear_size = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_copy_bps_limit = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_dd_blocksize = 1M {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_name_template = volume-%s {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_service_inithost_offload = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volume_usage_audit_period = month {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] zoning_mode = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_concurrency.disable_process_locking = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.auth_section = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.auth_type = password {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.auth_version = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.cache = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.include_service_catalog = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.insecure = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.interface = public {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_password = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcache_username = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.region_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.service_type = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.220/identity {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.backend = dogpile.cache.null {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.backend_argument = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.backend_expiration_time = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.config_prefix = cache.oslo {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.debug_cache_backend = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.enable_retry_client = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.enable_socket_keepalive = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.expiration_time = 600 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.hashclient_retry_attempts = 2 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_dead_retry = 300 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_pool_maxsize = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_sasl_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.password = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.proxies = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.redis_db = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.redis_server = localhost:6379 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.retry_attempts = 2 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.retry_delay = 0.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.socket_keepalive_count = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.socket_keepalive_idle = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.socket_keepalive_interval = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.socket_timeout = 1.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.tls_allowed_ciphers = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.tls_cafile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.tls_certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.tls_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.tls_keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cache.username = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] coordination.backend_url = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.asyncio_connection = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.asyncio_slave_connection = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.backend = sqlalchemy {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.connection = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.connection_debug = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.connection_parameters = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.connection_recycle_time = 3600 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.connection_trace = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.db_inc_retry_interval = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.db_max_retries = 20 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.db_max_retry_interval = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.db_retry_interval = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.max_overflow = 50 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.max_pool_size = 5 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.max_retries = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.mysql_wsrep_sync_wait = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:19 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.pool_timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.retry_interval = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.slave_connection = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.sqlite_synchronous = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.synchronous_reader = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] database.use_db_reconnect = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.connection_string = messaging:// {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.es_doc_type = notification {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.es_scroll_size = 10000 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.es_scroll_time = 2m {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.filter_error_trace = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.hmac_keys = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.sentinel_service_name = mymaster {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.socket_timeout = 0.1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.trace_requests = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler.trace_sqlalchemy = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler_jaeger.process_tags = {} {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler_jaeger.service_name_prefix = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] profiler_otlp.service_name_prefix = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.enforce_new_defaults = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.policy_default_rule = default {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.policy_file = policy.yaml {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.group = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.helper_command = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] privsep_osbrick.user = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.group = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.helper_command = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] cinder_sys_admin.user = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.auth_section = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.auth_type = password {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.cafile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.collect_timing = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.insecure = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.send_service_user_token = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.split_loggers = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] service_user.timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.auth_section = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.auth_type = password {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.collect_timing = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.insecure = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.region_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.split_loggers = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] glance.timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.backend_availability_zone = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.chap_password = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.chap_username = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87901) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 29 16:01:20 devstack cinder-volume[87901]: WARNING cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 29 16:01:20 devstack cinder-volume[87901]: WARNING cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Running cmd (subprocess): mount.quobyte {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.disk_geometry = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.driver_client_cert = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.driver_client_cert_key = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.driver_data_namespace = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.driver_use_ssl = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.extra_capabilities = {} {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.filter_function = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.goodness_function = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.iscsi_target_flags = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.iscsi_write_cache = on {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.iser_helper = tgtadm {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.iser_ip_address = 192.168.122.220 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.iser_port = 3260 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_host = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_login = admin {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_mount_options = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_password = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_private_key = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_share_path = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.num_shell_tries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.quobyte_volume_url = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.replication_device = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.report_discard_supported = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.reserved_percentage = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.target_helper = tgtadm {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.target_ip_address = 192.168.122.220 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.target_port = 3260 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.target_protocol = iscsi {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.trace_flags = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.unique_fqdn_network = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.use_chap_auth = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_backend_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_clear = zero {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_clear_ionice = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_clear_size = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_reports.file_event_handler = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_reports.log_dir = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.backend_availability_zone = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.backend_host = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.chap_password = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.chap_username = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.chiscsi_conf = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.disk_geometry = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.driver_client_cert = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.driver_data_namespace = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.driver_use_ssl = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.extra_capabilities = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.filter_function = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.goodness_function = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.iser_helper = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.iser_ip_address = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.iser_port = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.iser_target_prefix = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_host = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_login = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_mount_options = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_password = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_private_key = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_share_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_ssh_port = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.num_shell_tries = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.nvmet_port_id = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.replication_device = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.report_discard_supported = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.reserved_percentage = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.scst_target_driver = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.storage_protocol = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.target_helper = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.target_ip_address = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.target_port = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.target_prefix = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.target_protocol = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.trace_flags = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.use_chap_auth = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_clear = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_clear_size = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] QuobyteHD.volumes_dir = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=87901) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: INFO cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 ... Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 -c /etc/quobyte/client-cinder.cfg {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_notifications.driver = [] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_notifications.retry = -1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] key_manager.fixed_key = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.barbican_api_version = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.barbican_endpoint = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.barbican_endpoint_type = public {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.barbican_region_name = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.cafile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.collect_timing = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.insecure = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.number_of_retries = 60 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.retry_delay = 1 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.send_service_user_token = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.split_loggers = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.verify_ssl = True {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican.verify_ssl_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.auth_section = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.auth_type = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.cafile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.certfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.collect_timing = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.insecure = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 -c /etc/quobyte/client-cinder.cfg Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.keyfile = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.split_loggers = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] barbican_service_user.timeout = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.approle_role_id = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.approle_secret_id = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.auth_method = approle {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.auth_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.kv_mountpoint = secret {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.kv_path = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.kv_version = 2 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.namespace = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.root_token_id = **** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.ssl_ca_crt_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.timeout = 60.0 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.token_file = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.token_role = None {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.use_ssl = False {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:20 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] ******************************************************************************** {{(pid=87628) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 29 16:01:20 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.422s {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:20 devstack cinder-volume[87901]: INFO cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 succeeded Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=87901) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.442s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:20 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:20 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:20 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.258s {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:20 devstack cinder-volume[87901]: INFO cinder.volume.driver [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Driver hasn't implemented _init_vendor_properties() Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG cinder.volume.driver [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6993598937988, 'free_capacity_gb': 1775.6993598937988, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87901) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG oslo_db.sqlalchemy.engines [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87901) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:20 devstack cinder-volume[87901]: DEBUG dbcounter [-] [87901] Writer thread running {{(pid=87901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.db.sqlalchemy.api [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Building query based on filter {{(pid=87901) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.image.image_utils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87901) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 29 16:01:21 devstack cinder-volume[87901]: INFO cinder.keymgr.migration [None req-018b5186-195f-4888-9fc1-6877d29cdacd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=87901) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=87901) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:21 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:21 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:21 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.256s {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Notifying Schedulers of capabilities ... {{(pid=87901) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:01:21 devstack cinder-volume[87901]: INFO cinder.volume.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Driver initialization completed successfully. Jul 29 16:01:21 devstack cinder-volume[87901]: INFO cinder.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Initiating service 3 cleanup Jul 29 16:01:21 devstack cinder-volume[87901]: INFO cinder.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Service 3 cleanup completed. Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.service [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Creating RPC server for service cinder-volume {{(pid=87901) start /opt/stack/cinder/cinder/service.py:231}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.service [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87901) start /opt/stack/cinder/cinder/service.py:237}} Jul 29 16:01:21 devstack cinder-volume[87901]: INFO cinder.volume.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=87901) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=87901) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:21 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:21 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:21 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:21 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.345s {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:21 devstack cinder-volume[87901]: INFO cinder.volume.manager [None req-bf9c2ac9-6458-42de-8792-189180297fdc None None] Driver post RPC initialization completed successfully. Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=87901) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG cinder.volume.drivers.quobyte [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=87901) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87901) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:26 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:26 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:26 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG oslo_concurrency.processutils [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.276s {{(pid=87901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:26 devstack cinder-volume[87901]: DEBUG cinder.manager [None req-d02ce34e-e50a-41f9-bb17-e8c0366f2ff8 None None] Notifying Schedulers of capabilities ... {{(pid=87901) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:01:27 devstack cinder-volume[87628]: INFO oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Caught SIGTERM, stopping children Jul 29 16:01:27 devstack cinder-volume[87628]: DEBUG oslo_concurrency.lockutils [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Acquiring lock "singleton_lock" {{(pid=87628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 16:01:27 devstack cinder-volume[87628]: DEBUG oslo_concurrency.lockutils [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Acquired lock "singleton_lock" {{(pid=87628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 16:01:27 devstack cinder-volume[87628]: DEBUG oslo_concurrency.lockutils [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Releasing lock "singleton_lock" {{(pid=87628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 16:01:27 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Stop services. {{(pid=87628) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 29 16:01:27 devstack cinder-volume[87628]: DEBUG oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Killing children. {{(pid=87628) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 29 16:01:27 devstack cinder-volume[87628]: INFO oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Waiting on 1 children to exit Jul 29 16:01:29 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Acquiring lock "singleton_lock" {{(pid=87901) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 16:01:29 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Acquired lock "singleton_lock" {{(pid=87901) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 16:01:29 devstack cinder-volume[87901]: DEBUG oslo_concurrency.lockutils [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Releasing lock "singleton_lock" {{(pid=87901) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 16:01:29 devstack cinder-volume[87901]: WARNING amqp [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 29 16:01:29 devstack cinder-volume[87901]: WARNING amqp [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 29 16:01:29 devstack cinder-volume[87628]: INFO oslo_service.backend._eventlet.service [None req-9889ef80-01c5-45b5-b720-8a0cf4271ee1 None None] Child 87901 exited with status 0 Jul 29 16:01:30 devstack cinder-volume[88310]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 29 16:01:30 devstack cinder-volume[88310]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 29 16:01:30 devstack cinder-volume[88310]: we strongly recommend against using it for new projects. Jul 29 16:01:30 devstack cinder-volume[88310]: If you are already using Eventlet, we recommend migrating to a different Jul 29 16:01:30 devstack cinder-volume[88310]: framework. For more detail see Jul 29 16:01:30 devstack cinder-volume[88310]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 29 16:01:30 devstack cinder-volume[88310]: import eventlet # noqa Jul 29 16:01:33 devstack cinder-volume[88310]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 29 16:01:33 devstack cinder-volume[88310]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 29 16:01:33 devstack cinder-volume[88310]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 29 16:01:34 devstack cinder-volume[88310]: INFO dbcounter [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Registered counter for database cinder Jul 29 16:01:34 devstack cinder-volume[88310]: DEBUG oslo_db.sqlalchemy.engines [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG dbcounter [-] [88310] Writer thread running {{(pid=88310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 29 16:01:35 devstack cinder-volume[88310]: INFO cinder.rpc [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 29 16:01:35 devstack cinder-volume[88310]: INFO cinder.rpc [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_db.sqlalchemy.engines [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:35 devstack cinder-volume[88310]: INFO cinder.volume.manager [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Determined volume DB was empty at startup. Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG cinder.volume.manager [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88310) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 29 16:01:35 devstack cinder-volume[88310]: WARNING stevedore.named [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 29 16:01:35 devstack cinder-volume[88310]: WARNING castellan.key_manager [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 16:01:35 devstack cinder-volume[88310]: WARNING cinder.keymgr.conf_key_mgr [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 29 16:01:35 devstack cinder-volume[88310]: INFO cinder.volume.manager [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_db.sqlalchemy.engines [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:35 devstack cinder-volume[88310]: INFO oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Starting 1 workers Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Started child 88575 {{(pid=88310) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Full set of CONF: {{(pid=88310) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] ******************************************************************************** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] Configuration options gathered from: {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] ================================================================================ {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] allow_availability_zone_fallback = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] allow_compression_on_image_upload = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] allowed_direct_url_schemes = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] api_rate_limit = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] auth_strategy = keystone {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_availability_zone = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_host = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88575]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.1) Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_stats_polling_interval = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backup_api_class = cinder.backup.api.API {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backup_name_template = backup-%s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backup_use_same_host = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backup_use_temp_snapshot = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] chap_password = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] chap_username = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_internal_tenant_project_id = 0d3ddaa662ae49f1925aeb7d6367c2bd {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_internal_tenant_user_id = 11c52eaa91d0496b99f8f70415722ce5 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cluster = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] compression_format = gzip {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] compute_api_class = cinder.compute.nova.API {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] config_dir = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] config_source = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] control_exchange = openstack {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] debug = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] default_availability_zone = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] default_group_type = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] default_volume_type = QuobyteHD {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] disk_geometry = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] driver_client_cert = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] driver_client_cert_key = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] driver_data_namespace = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] driver_ssl_cert_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] driver_ssl_cert_verify = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] driver_use_ssl = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] enable_new_services = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] enable_unsupported_driver = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] enabled_backends = ['QuobyteHD'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] enforce_multipath_for_image_xfer = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] filter_function = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_api_insecure = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_api_servers = ['http://192.168.122.220/image'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_api_ssl_compression = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_ca_certificates_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_catalog_info = image:glance:publicURL {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_num_retries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance_request_timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] goodness_function = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] graceful_shutdown_timeout = 5 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] group_api_class = cinder.group.api.API {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] host = devstack {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_compress_on_upload = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_conversion_address_space_limit = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_conversion_cpu_limit = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_conversion_disable = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_upload_use_cinder_backend = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_upload_use_internal_tenant = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_volume_cache_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_volume_cache_max_count = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] image_volume_cache_max_size_gb = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] init_host_max_objects_retrieval = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] instance_format = [instance: %(uuid)s] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] iscsi_target_flags = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] iscsi_write_cache = on {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] iser_helper = tgtadm {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] iser_ip_address = 192.168.122.220 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] iser_port = 3260 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_color = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_config_append = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_dir = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_options = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_rotate_interval = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_rotate_interval_type = days {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] log_rotation_type = none {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] max_age = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] max_logfile_count = 30 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] max_logfile_size_mb = 200 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] max_over_subscription_ratio = 20.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] message_reap_interval = 86400 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] message_ttl = 2592000 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] migration_create_volume_timeout_secs = 300 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] monkey_patch = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] monkey_patch_modules = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] my_ip = 192.168.122.220 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] no_snapshot_gb_quota = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] num_iser_scan_tries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] num_shell_tries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] num_volume_device_scan_tries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] nvmeof_conn_info_version = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] nvmet_ns_id = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] nvmet_port_id = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_max_limit = 1000 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_volume_ext_list = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_volume_listen = 0.0.0.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_volume_listen_port = 8776 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_volume_use_ssl = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] osapi_volume_workers = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] per_volume_size_limit = -1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Starting volume driver QuobyteDriver (1.2) Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88575) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] periodic_fuzzy_delay = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] periodic_interval = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] project_id_regex = [0-9a-f\-]+ {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] public_endpoint = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] publish_errors = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_backup_gigabytes = 1000 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_backups = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_gigabytes = 1000 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_groups = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_snapshots = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] quota_volumes = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] rate_limit_burst = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] rate_limit_except_level = CRITICAL {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] rate_limit_interval = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] reinit_driver_count = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] replication_device = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] report_discard_supported = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] report_interval = 120 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] reservation_clean_interval = 86400 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] reservation_expire = 86400 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] reserved_image_namespaces = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] reserved_percentage = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] rpc_response_timeout = 120 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] run_external_periodic_tasks = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] scst_target_driver = iscsi {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] scst_target_iqn_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_down_time = 720 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] shell_completion = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] snapshot_name_template = snapshot-%s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] split_loggers = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] state_path = /opt/stack/data/cinder {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] storage_availability_zone = nova {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] storage_protocol = iSCSI {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] syslog_log_facility = LOG_USER {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] target_helper = lioadm {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] target_ip_address = 192.168.122.220 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] target_port = 3260 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] target_protocol = iscsi {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] target_secondary_ip_addresses = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] trace_flags = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] transfer_api_class = cinder.transfer.api.API {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] transport_url = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] until_refresh = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_chap_auth = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_default_quota_class = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_journal = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_json = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_multipath_for_image_xfer = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_stderr = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] use_syslog = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] verify_glance_signatures = enabled {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_api_class = cinder.volume.api.API {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_backend_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_clear = zero {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_clear_ionice = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_clear_size = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_copy_bps_limit = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_dd_blocksize = 1M {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_name_template = volume-%s {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_service_inithost_offload = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volume_usage_audit_period = month {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] zoning_mode = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_concurrency.disable_process_locking = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.auth_section = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.auth_type = password {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.auth_version = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.cache = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.delay_auth_decision = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.http_connect_timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.include_service_catalog = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.insecure = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.interface = public {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_password = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcache_username = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.region_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.service_token_roles_required = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.service_type = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.token_cache_time = 300 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.220/identity {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.backend = dogpile.cache.null {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.backend_argument = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.backend_expiration_time = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.config_prefix = cache.oslo {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.debug_cache_backend = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.enable_retry_client = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.enable_socket_keepalive = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.expiration_time = 600 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.hashclient_retry_attempts = 2 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_dead_retry = 300 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_pool_maxsize = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_sasl_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.password = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.proxies = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.redis_db = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.redis_sentinel_service_name = mymaster {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.redis_server = localhost:6379 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.retry_attempts = 2 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.retry_delay = 0.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.socket_keepalive_count = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.socket_keepalive_idle = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.socket_keepalive_interval = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.socket_timeout = 1.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.tls_allowed_ciphers = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.tls_cafile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.tls_certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.tls_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.tls_keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cache.username = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] coordination.backend_url = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.asyncio_connection = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.asyncio_slave_connection = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.backend = sqlalchemy {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.connection = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.connection_debug = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.connection_parameters = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.connection_recycle_time = 3600 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.connection_trace = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.db_inc_retry_interval = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.db_max_retries = 20 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.db_max_retry_interval = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.db_retry_interval = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.max_overflow = 50 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.max_pool_size = 5 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.max_retries = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.mysql_wsrep_sync_wait = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.pool_timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.retry_interval = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.slave_connection = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.sqlite_synchronous = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.synchronous_reader = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] database.use_db_reconnect = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88575) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.connection_string = messaging:// {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.es_doc_type = notification {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.es_scroll_size = 10000 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.es_scroll_time = 2m {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.filter_error_trace = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.hmac_keys = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.sentinel_service_name = mymaster {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.socket_timeout = 0.1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.trace_requests = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler.trace_sqlalchemy = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler_jaeger.process_tags = {} {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Running cmd (subprocess): mount.quobyte {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler_jaeger.service_name_prefix = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] profiler_otlp.service_name_prefix = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.enforce_new_defaults = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.policy_default_rule = default {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.policy_file = policy.yaml {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_policy.remote_timeout = 60.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.group = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.helper_command = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] privsep_osbrick.user = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.group = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.helper_command = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] cinder_sys_admin.user = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.auth_section = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.auth_type = password {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.cafile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.collect_timing = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.insecure = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.send_service_user_token = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.split_loggers = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] service_user.timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.auth_section = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.auth_type = password {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.collect_timing = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.insecure = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.region_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.split_loggers = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] glance.timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.backend_availability_zone = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.chap_password = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.chap_username = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.disk_geometry = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.driver_client_cert = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.driver_client_cert_key = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.driver_data_namespace = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.driver_use_ssl = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.enable_unsupported_driver = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.extra_capabilities = {} {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.filter_function = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.goodness_function = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.iscsi_target_flags = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.iscsi_write_cache = on {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.iser_helper = tgtadm {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.iser_ip_address = 192.168.122.220 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.iser_port = 3260 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_host = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_login = admin {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_mount_options = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_password = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_private_key = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_share_path = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_ssh_port = 22 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.num_shell_tries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.nvmet_port_id = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_client_cfg = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.quobyte_volume_url = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.replication_device = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.report_discard_supported = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.reserved_percentage = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.scst_target_driver = iscsi {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.scst_target_iqn_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.storage_protocol = iSCSI {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.target_helper = tgtadm {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.target_ip_address = 192.168.122.220 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.target_port = 3260 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.target_protocol = iscsi {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.trace_flags = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.unique_fqdn_network = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.use_chap_auth = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_backend_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_clear = zero {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_clear_ionice = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_clear_size = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_reports.file_event_handler = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_reports.log_dir = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.backend_availability_zone = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.backend_host = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.chap_password = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.chap_username = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.chiscsi_conf = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.disk_geometry = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.driver_client_cert = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.driver_client_cert_key = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.driver_data_namespace = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.driver_use_ssl = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.extra_capabilities = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.filter_function = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.goodness_function = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.iscsi_target_flags = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.iscsi_write_cache = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.iser_helper = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.iser_ip_address = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.iser_port = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.iser_target_prefix = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_host = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_login = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_mount_options = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_password = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_private_key = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_share_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_ssh_port = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.num_shell_tries = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nvmet_ns_id = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.nvmet_port_id = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack quobyte-client[88576]: Reading configuration file: /etc/quobyte/client.cfg Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.replication_device = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.report_discard_supported = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.reserved_percentage = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.scst_target_driver = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack quobyte-client[88576]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.storage_protocol = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.target_helper = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.target_ip_address = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.target_port = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.target_prefix = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.target_protocol = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.trace_flags = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.unique_fqdn_network = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.use_chap_auth = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_clear = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_clear_ionice = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_clear_size = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] QuobyteHD.volumes_dir = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.ssl_version = {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_notifications.driver = [] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_notifications.retry = -1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] oslo_messaging_notifications.transport_url = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] key_manager.fixed_key = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.barbican_api_version = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.barbican_endpoint = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.barbican_endpoint_type = public {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.barbican_region_name = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.cafile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.collect_timing = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.insecure = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.number_of_retries = 60 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.retry_delay = 1 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.send_service_user_token = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.split_loggers = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.verify_ssl = True {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican.verify_ssl_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.auth_section = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.auth_type = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.cafile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.certfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.collect_timing = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.insecure = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.keyfile = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.split_loggers = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] barbican_service_user.timeout = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.approle_role_id = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.approle_secret_id = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.auth_method = approle {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.auth_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.kv_mountpoint = secret {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.kv_path = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.kv_version = 2 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.namespace = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.root_token_id = **** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.ssl_ca_crt_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.timeout = 60.0 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.token_file = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.token_role = None {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.use_ssl = False {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 29 16:01:35 devstack cinder-volume[88310]: DEBUG oslo_service.backend._eventlet.service [None req-556a125d-2bfa-43c1-b4f2-f7c469a4abad None None] ******************************************************************************** {{(pid=88310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 29 16:01:35 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:35 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:35 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.239s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:35 devstack cinder-volume[88575]: INFO cinder.volume.driver [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Driver hasn't implemented _init_vendor_properties() Jul 29 16:01:35 devstack cinder-volume[88575]: DEBUG cinder.volume.driver [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7427024841309, 'free_capacity_gb': 1775.7427024841309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88575) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88575) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writer thread running {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.db.sqlalchemy.api [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Building query based on filter {{(pid=88575) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88575) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:36 devstack cinder-volume[88575]: INFO cinder.keymgr.migration [None req-8aca0ecb-9d14-4056-8879-59cdd909255e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 29 16:01:36 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:36 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:36 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.230s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:01:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Driver initialization completed successfully. Jul 29 16:01:36 devstack cinder-volume[88575]: INFO cinder.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Initiating service 3 cleanup Jul 29 16:01:36 devstack cinder-volume[88575]: INFO cinder.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Service 3 cleanup completed. Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.service [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Creating RPC server for service cinder-volume {{(pid=88575) start /opt/stack/cinder/cinder/service.py:231}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.service [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88575) start /opt/stack/cinder/cinder/service.py:237}} Jul 29 16:01:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:01:36 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:01:36 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:01:36 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Jul 29 16:01:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.237s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:01:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4ba25c7e-10e4-4bd5-85a9-5a84c98ed8af None None] Driver post RPC initialization completed successfully. Jul 29 16:01:45 devstack cinder-volume[88310]: DEBUG dbcounter [-] [88310] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:01:46 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:01:46 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=3 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:02:36 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:02:36 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:02:36 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:02:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:02:46 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:02:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Flow 'volume_create_manager' (08448905-0364-44b5-be4c-e2dd4dd85e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:02:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352befa0-436a-4018-975b-6a98d7abc666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352befa0-436a-4018-975b-6a98d7abc666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-992192883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8525fc44-c07f-4150-86a4-a4cfefe3609d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e0c1fe6c3e42968381cfe44778020e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:02:47Z,use_quota=True,user_id='f13798132f414552abaafb6c28e46b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b321901-0343-4450-aa7f-955a64a6ceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b321901-0343-4450-aa7f-955a64a6ceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205f920a-1eb7-4bfe-8348-2023b380a8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205f920a-1eb7-4bfe-8348-2023b380a8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8525fc44-c07f-4150-86a4-a4cfefe3609d', 'volume_name': 'volume-8525fc44-c07f-4150-86a4-a4cfefe3609d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12558beb-016f-49cf-ac70-c4d90c2154a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12558beb-016f-49cf-ac70-c4d90c2154a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd12baa0-eeba-4454-b1b0-ba98c3a437b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:02:47 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Volume 8525fc44-c07f-4150-86a4-a4cfefe3609d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8525fc44-c07f-4150-86a4-a4cfefe3609d', 'volume_size': 1} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-992192883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8525fc44-c07f-4150-86a4-a4cfefe3609d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e0c1fe6c3e42968381cfe44778020e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:02:47Z,use_quota=True,user_id='f13798132f414552abaafb6c28e46b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Creating volume 8525fc44-c07f-4150-86a4-a4cfefe3609d {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:02:47 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:02:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:02:47 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d 1073741824 Jul 29 16:02:47 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:02:48 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d 1073741824" returned: 0 in 0.906s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:02:48 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d Jul 29 16:02:48 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:02:48 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d" returned: 0 in 0.382s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd12baa0-eeba-4454-b1b0-ba98c3a437b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8525fc44-c07f-4150-86a4-a4cfefe3609d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10dc228-29c4-4d10-8c67-46d07a6c720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:02:48 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Volume volume-8525fc44-c07f-4150-86a4-a4cfefe3609d (8525fc44-c07f-4150-86a4-a4cfefe3609d): created successfully Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10dc228-29c4-4d10-8c67-46d07a6c720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:02:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Flow 'volume_create_manager' (08448905-0364-44b5-be4c-e2dd4dd85e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:02:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-210d3953-da2c-4c93-93cd-01dccfc44466 tempest-TaggedAttachmentsTest-915187347 None] Created volume successfully. Jul 29 16:02:58 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:02:58 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:03:09 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Flow 'volume_create_manager' (d2cb51ce-bcce-464a-a5f5-72303f02408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fbbdb7-7d82-48a2-8873-77d0e9e3c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fbbdb7-7d82-48a2-8873-77d0e9e3c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1572016861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978c7aef-ddfe-44e3-a53e-f19ba1957ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607925ba52734ef8a685ea11e063e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:03:10Z,use_quota=True,user_id='0a0b4f8b409043f1ae8ad6982d17a3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3558d913-08b0-4db2-a20b-d9231aeb3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3558d913-08b0-4db2-a20b-d9231aeb3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a452951-b9c4-420b-ab28-bf4ff7bd4614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a452951-b9c4-420b-ab28-bf4ff7bd4614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978c7aef-ddfe-44e3-a53e-f19ba1957ac3', 'volume_name': 'volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8fbc64-e744-491a-9788-6f7765177a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8fbc64-e744-491a-9788-6f7765177a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5d657a-1069-4b8e-89ed-4415daeb60be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Volume 978c7aef-ddfe-44e3-a53e-f19ba1957ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3', 'volume_size': 1} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1572016861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978c7aef-ddfe-44e3-a53e-f19ba1957ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607925ba52734ef8a685ea11e063e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:03:10Z,use_quota=True,user_id='0a0b4f8b409043f1ae8ad6982d17a3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Creating volume 978c7aef-ddfe-44e3-a53e-f19ba1957ac3 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:03:10 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:10 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 1073741824 Jul 29 16:03:10 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:10 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 1073741824" returned: 0 in 0.801s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:11 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 Jul 29 16:03:11 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:11 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5d657a-1069-4b8e-89ed-4415daeb60be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f8142c-cf98-4e10-91cc-aa5e48905476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Volume volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 (978c7aef-ddfe-44e3-a53e-f19ba1957ac3): created successfully Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f8142c-cf98-4e10-91cc-aa5e48905476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Flow 'volume_create_manager' (d2cb51ce-bcce-464a-a5f5-72303f02408a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:03:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-18e26e32-94ca-4fcf-9c3a-352018fc9ad0 tempest-VolumesAdminNegativeTest-189727259 None] Created volume successfully. Jul 29 16:03:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Acquiring lock "cinder-978c7aef-ddfe-44e3-a53e-f19ba1957ac3-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:03:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Lock "cinder-978c7aef-ddfe-44e3-a53e-f19ba1957ac3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:03:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Acquiring lock "cinder-quobyte-978c7aef-ddfe-44e3-a53e-f19ba1957ac3" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:03:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Lock "cinder-quobyte-978c7aef-ddfe-44e3-a53e-f19ba1957ac3" acquired by "delete_volume" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:03:12 devstack cinder-volume[88575]: INFO oslo.privsep.daemon [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdox14gr5/privsep.sock'] Jul 29 16:03:12 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdox14gr5/privsep.sock Jul 29 16:03:12 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: Jul 29 16:03:14 devstack cinder-volume[88575]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 29 16:03:14 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:14 devstack cinder-volume[88575]: INFO oslo.privsep.daemon [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Spawned new privsep daemon via rootwrap Jul 29 16:03:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Accepted privsep connection to /tmp/tmpdox14gr5/privsep.sock {{(pid=88575) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 29 16:03:14 devstack cinder-volume[88575]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 29 16:03:14 devstack cinder-volume[88575]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 29 16:03:14 devstack cinder-volume[88575]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 29 16:03:14 devstack cinder-volume[88575]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89603 Jul 29 16:03:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4fb59-1501-46ed-bfe2-b4b3f9285860]: (2,) {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:03:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251f55b-7155-4cae-978e-cd96bc049aac]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:03:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:14 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 Jul 29 16:03:14 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:15 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3" returned: 0 in 0.636s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:15 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3 Jul 29 16:03:15 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:15 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-978c7aef-ddfe-44e3-a53e-f19ba1957ac3" returned: 0 in 0.353s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Lock "cinder-quobyte-978c7aef-ddfe-44e3-a53e-f19ba1957ac3" released by "delete_volume" :: held 2.883s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:03:15 devstack cinder-volume[88575]: WARNING cinder.quota [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:03:15 devstack cinder-volume[88575]: WARNING cinder.quota [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:03:15 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Created reservations ['6c701623-233c-469d-8749-942e0b3a8497', '0f2fe925-db1b-4faf-b732-7bdde39c1dbd', '4427f90b-61d0-41fc-8b3a-ebb1a62b7891', '6593f525-1296-435b-9d80-0083eb6ad4a2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:16 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:03:16 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:16 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.656s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:03:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Deleted volume successfully. Jul 29 16:03:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ad9a75a1-3fe8-475b-9748-82a5c969e213 tempest-VolumesAdminNegativeTest-189727259 None] Lock "cinder-978c7aef-ddfe-44e3-a53e-f19ba1957ac3-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Flow 'volume_create_manager' (1ec41627-1f02-4548-b43e-b196a98dba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1425e8da-588a-4c75-8161-8bf13b79a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1425e8da-588a-4c75-8161-8bf13b79a529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-564173944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107787c2-8381-4445-b0e8-931b11aac4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7695e6d5d1be4515bd00b3b2a6e472be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:03:25Z,use_quota=True,user_id='535e099a90ac4b28bc9bade345078db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738c7024-6045-4d8a-89d2-9a88a57f6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738c7024-6045-4d8a-89d2-9a88a57f6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981bab6d-19e6-46a5-92d0-3e1fed003957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981bab6d-19e6-46a5-92d0-3e1fed003957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107787c2-8381-4445-b0e8-931b11aac4a1', 'volume_name': 'volume-107787c2-8381-4445-b0e8-931b11aac4a1', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490f517f-aa7d-46d1-b28f-8c40aa251b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490f517f-aa7d-46d1-b28f-8c40aa251b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee14deb9-edb0-4e0f-9be9-59c3ca358020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Volume 107787c2-8381-4445-b0e8-931b11aac4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107787c2-8381-4445-b0e8-931b11aac4a1', 'volume_size': 1} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-564173944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107787c2-8381-4445-b0e8-931b11aac4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7695e6d5d1be4515bd00b3b2a6e472be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:03:25Z,use_quota=True,user_id='535e099a90ac4b28bc9bade345078db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Creating volume 107787c2-8381-4445-b0e8-931b11aac4a1 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:03:24 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:03:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:24 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 1073741824 Jul 29 16:03:24 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:25 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 1073741824" returned: 0 in 0.790s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:25 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 Jul 29 16:03:25 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:26 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee14deb9-edb0-4e0f-9be9-59c3ca358020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107787c2-8381-4445-b0e8-931b11aac4a1', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329c9af9-3668-4951-a3e6-821c555788a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:03:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Volume volume-107787c2-8381-4445-b0e8-931b11aac4a1 (107787c2-8381-4445-b0e8-931b11aac4a1): created successfully Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329c9af9-3668-4951-a3e6-821c555788a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:03:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Flow 'volume_create_manager' (1ec41627-1f02-4548-b43e-b196a98dba24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:03:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b68888ad-94e2-406e-a187-77f272c651e0 tempest-ServerActionsTestOtherA-375942156 None] Created volume successfully. Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:03:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:03:36 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:03:36 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:03:37 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Jul 29 16:03:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.718s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:03:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:03:46 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:03:46 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:04:00 devstack cinder-volume[88575]: WARNING py.warnings [req-1f7caecf-c81a-4b75-8cbc-5da6942ae069 req-f4ec1484-ddea-4df4-915d-23b438900eeb tempest-TaggedAttachmentsTest-915187347 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 29 16:04:00 devstack cinder-volume[88575]: .first() Jul 29 16:04:00 devstack cinder-volume[88575]: Jul 29 16:04:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1f7caecf-c81a-4b75-8cbc-5da6942ae069 req-f4ec1484-ddea-4df4-915d-23b438900eeb tempest-TaggedAttachmentsTest-915187347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1f7caecf-c81a-4b75-8cbc-5da6942ae069 req-f4ec1484-ddea-4df4-915d-23b438900eeb tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1f7caecf-c81a-4b75-8cbc-5da6942ae069 req-f4ec1484-ddea-4df4-915d-23b438900eeb tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-1f7caecf-c81a-4b75-8cbc-5da6942ae069 req-f4ec1484-ddea-4df4-915d-23b438900eeb tempest-TaggedAttachmentsTest-915187347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-8525fc44-c07f-4150-86a4-a4cfefe3609d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bf9d5f1-e016-417a-a062-d07bde026cbb', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:04:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-1f7caecf-c81a-4b75-8cbc-5da6942ae069 req-f4ec1484-ddea-4df4-915d-23b438900eeb tempest-TaggedAttachmentsTest-915187347 None] attachment_update completed successfully. Jul 29 16:04:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-4d59020a-541e-420f-8275-a197b62c4a87 req-a6cb75ea-ae67-4b06-9a0e-db33fe326703 tempest-TaggedAttachmentsTest-915187347 None] Terminate volume connection completed successfully. Jul 29 16:04:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-4d59020a-541e-420f-8275-a197b62c4a87 req-a6cb75ea-ae67-4b06-9a0e-db33fe326703 tempest-TaggedAttachmentsTest-915187347 None] Deleting attachment 0bf9d5f1-e016-417a-a062-d07bde026cbb. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:04:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-6f17c361-95b5-40f3-b860-5af8a7429903 req-174ad188-7143-4f09-b51b-8447a9281e87 tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-6f17c361-95b5-40f3-b860-5af8a7429903 req-174ad188-7143-4f09-b51b-8447a9281e87 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-6f17c361-95b5-40f3-b860-5af8a7429903 req-174ad188-7143-4f09-b51b-8447a9281e87 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-6f17c361-95b5-40f3-b860-5af8a7429903 req-174ad188-7143-4f09-b51b-8447a9281e87 tempest-ServerActionsTestOtherA-375942156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-107787c2-8381-4445-b0e8-931b11aac4a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9b0bc8f-ddc5-4cbf-a9cb-7147a66f56f5', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:04:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-6f17c361-95b5-40f3-b860-5af8a7429903 req-174ad188-7143-4f09-b51b-8447a9281e87 tempest-ServerActionsTestOtherA-375942156 None] attachment_update completed successfully. Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Flow 'volume_create_manager' (b18eb458-ec92-4759-9a45-7394c6b8311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca91ab5-2be4-492f-8d15-55485c7db4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca91ab5-2be4-492f-8d15-55485c7db4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-372772857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3511f7-6a62-42b6-b283-9e5e910e5dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6898c7518c3849259806db7ea6d7df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:04:15Z,use_quota=True,user_id='7654d96dc8c94e18aed148b85ed83f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5734342e-2d1b-463b-afd8-cddd5ae239e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5734342e-2d1b-463b-afd8-cddd5ae239e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed01439f-fdcf-4d01-a4af-f3c27bc5bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed01439f-fdcf-4d01-a4af-f3c27bc5bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3511f7-6a62-42b6-b283-9e5e910e5dc5', 'volume_name': 'volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b75222-081f-4849-9dc3-3595d39457ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b75222-081f-4849-9dc3-3595d39457ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6152f0-c40d-4923-8837-a55d074bdba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Volume 1b3511f7-6a62-42b6-b283-9e5e910e5dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5', 'volume_size': 1} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-372772857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3511f7-6a62-42b6-b283-9e5e910e5dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6898c7518c3849259806db7ea6d7df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:04:15Z,use_quota=True,user_id='7654d96dc8c94e18aed148b85ed83f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Creating volume 1b3511f7-6a62-42b6-b283-9e5e910e5dc5 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:04:15 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:04:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:15 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 1073741824 Jul 29 16:04:15 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Flow 'volume_create_manager' (c9fb80e8-f094-4b11-ac35-517219a91d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f8baf9-ee00-42ae-bd0d-521dc5da815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f8baf9-ee00-42ae-bd0d-521dc5da815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2094818182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e62aeb5-cb92-4078-85b0-5b3e1c209faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0339eaf07c8145879c6d128e0b8b5dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:04:16Z,use_quota=True,user_id='4ab8ee3db0d3445da2152eee0360ccc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aba6ab-01b9-4810-8da8-2947e32e711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aba6ab-01b9-4810-8da8-2947e32e711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eba058b-0650-4fd4-805b-a87d2693a6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eba058b-0650-4fd4-805b-a87d2693a6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e62aeb5-cb92-4078-85b0-5b3e1c209faf', 'volume_name': 'volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d766dff6-177c-477f-9ecb-6a4934a4d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d766dff6-177c-477f-9ecb-6a4934a4d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddd0893-a4f3-47c1-93d1-3ad0168605e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:16 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Volume 2e62aeb5-cb92-4078-85b0-5b3e1c209faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf', 'volume_size': 1} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:16 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 1073741824" returned: 0 in 0.757s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:16 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 Jul 29 16:04:16 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:16 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2094818182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e62aeb5-cb92-4078-85b0-5b3e1c209faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0339eaf07c8145879c6d128e0b8b5dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:04:16Z,use_quota=True,user_id='4ab8ee3db0d3445da2152eee0360ccc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Creating volume 2e62aeb5-cb92-4078-85b0-5b3e1c209faf {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:04:17 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6152f0-c40d-4923-8837-a55d074bdba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d2595f-9bb1-45c8-9bd3-d72b07bbaa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:17 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf 1073741824 Jul 29 16:04:17 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Volume volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 (1b3511f7-6a62-42b6-b283-9e5e910e5dc5): created successfully Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d2595f-9bb1-45c8-9bd3-d72b07bbaa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Flow 'volume_create_manager' (b18eb458-ec92-4759-9a45-7394c6b8311d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:04:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fac227c1-4dc0-4955-8c69-a14f5a2e8bb1 tempest-AttachVolumeTestJSON-1505021882 None] Created volume successfully. Jul 29 16:04:17 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf 1073741824" returned: 0 in 0.714s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:17 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf Jul 29 16:04:17 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:18 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf" returned: 0 in 0.682s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddd0893-a4f3-47c1-93d1-3ad0168605e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94fefbf-c9ab-4bc5-b2bd-832e17da948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:04:18 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Volume volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf (2e62aeb5-cb92-4078-85b0-5b3e1c209faf): created successfully Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94fefbf-c9ab-4bc5-b2bd-832e17da948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:04:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Flow 'volume_create_manager' (c9fb80e8-f094-4b11-ac35-517219a91d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:04:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-80bbfcfa-c24c-499a-8ef7-d3f304366b7a tempest-DeleteServersTestJSON-1614047414 None] Created volume successfully. Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Acquiring lock "cinder-8525fc44-c07f-4150-86a4-a4cfefe3609d-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Lock "cinder-8525fc44-c07f-4150-86a4-a4cfefe3609d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Acquiring lock "cinder-quobyte-8525fc44-c07f-4150-86a4-a4cfefe3609d" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Lock "cinder-quobyte-8525fc44-c07f-4150-86a4-a4cfefe3609d" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1607224-7336-488c-9f44-ca22bf3b91c8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:19 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d Jul 29 16:04:19 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-445c6400-bdc0-4b8a-9601-0cac9e29d835 req-3d20f974-1132-4158-94c7-fba9e507b8bf tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-445c6400-bdc0-4b8a-9601-0cac9e29d835 req-3d20f974-1132-4158-94c7-fba9e507b8bf tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-445c6400-bdc0-4b8a-9601-0cac9e29d835 req-3d20f974-1132-4158-94c7-fba9e507b8bf tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-445c6400-bdc0-4b8a-9601-0cac9e29d835 req-3d20f974-1132-4158-94c7-fba9e507b8bf tempest-AttachVolumeTestJSON-1505021882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '765e66e9-dfbc-4bc9-9fe2-09c9bf47aee8', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:04:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-445c6400-bdc0-4b8a-9601-0cac9e29d835 req-3d20f974-1132-4158-94c7-fba9e507b8bf tempest-AttachVolumeTestJSON-1505021882 None] attachment_update completed successfully. Jul 29 16:04:20 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d" returned: 0 in 0.688s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:20 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d Jul 29 16:04:20 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-a9990bd8-4f2a-4d5d-8deb-d1e114b5a2c7 tempest-ServerActionsTestOtherA-375942156 None] Terminate volume connection completed successfully. Jul 29 16:04:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-a9990bd8-4f2a-4d5d-8deb-d1e114b5a2c7 tempest-ServerActionsTestOtherA-375942156 None] Deleting attachment c9b0bc8f-ddc5-4cbf-a9cb-7147a66f56f5. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:04:20 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8525fc44-c07f-4150-86a4-a4cfefe3609d" returned: 0 in 0.759s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Lock "cinder-quobyte-8525fc44-c07f-4150-86a4-a4cfefe3609d" released by "delete_volume" :: held 1.526s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Created reservations ['990383eb-3c55-4d20-a5e8-38c63ea9598a', '08f093ab-1a9d-457f-bf00-bd4e1fcd275b', '14859f00-3c6e-4ba7-82c7-9601c3a99fcb', 'c2f58a6d-85da-4549-84fb-7f0866ded164'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:21 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:04:21 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1882ba0d-faed-4695-9b76-45c3ae9c42e6 req-b0b3d4f5-6b9d-45e9-b34b-c1a1daf93b64 tempest-DeleteServersTestJSON-1614047414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1882ba0d-faed-4695-9b76-45c3ae9c42e6 req-b0b3d4f5-6b9d-45e9-b34b-c1a1daf93b64 tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1882ba0d-faed-4695-9b76-45c3ae9c42e6 req-b0b3d4f5-6b9d-45e9-b34b-c1a1daf93b64 tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-1882ba0d-faed-4695-9b76-45c3ae9c42e6 req-b0b3d4f5-6b9d-45e9-b34b-c1a1daf93b64 tempest-DeleteServersTestJSON-1614047414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7a000d9-dbdb-45ea-8db4-a621f994a757', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:04:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-1882ba0d-faed-4695-9b76-45c3ae9c42e6 req-b0b3d4f5-6b9d-45e9-b34b-c1a1daf93b64 tempest-DeleteServersTestJSON-1614047414 None] attachment_update completed successfully. Jul 29 16:04:21 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.611s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:04:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Deleted volume successfully. Jul 29 16:04:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1823c180-7fb5-4f9d-8c62-7929612f0399 tempest-TaggedAttachmentsTest-915187347 None] Lock "cinder-8525fc44-c07f-4150-86a4-a4cfefe3609d-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:04:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-be5bb839-fd35-493f-83a8-7cdab454d88c tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-be5bb839-fd35-493f-83a8-7cdab454d88c tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-be5bb839-fd35-493f-83a8-7cdab454d88c tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-be5bb839-fd35-493f-83a8-7cdab454d88c tempest-ServerActionsTestOtherA-375942156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-107787c2-8381-4445-b0e8-931b11aac4a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93c01327-3596-4af1-b5be-43b3089164cb', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:04:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-52eb9123-819d-4d20-9510-437c3c652bc8 req-be5bb839-fd35-493f-83a8-7cdab454d88c tempest-ServerActionsTestOtherA-375942156 None] attachment_update completed successfully. Jul 29 16:04:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-afef9502-d81a-45cb-88f9-fba877590877 req-057d8285-09ca-4feb-8f30-e11c055c22fa tempest-DeleteServersTestJSON-1614047414 None] Terminate volume connection completed successfully. Jul 29 16:04:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-afef9502-d81a-45cb-88f9-fba877590877 req-057d8285-09ca-4feb-8f30-e11c055c22fa tempest-DeleteServersTestJSON-1614047414 None] Deleting attachment f7a000d9-dbdb-45ea-8db4-a621f994a757. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:04:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Acquiring lock "cinder-2e62aeb5-cb92-4078-85b0-5b3e1c209faf-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:04:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Lock "cinder-2e62aeb5-cb92-4078-85b0-5b3e1c209faf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:04:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Acquiring lock "cinder-quobyte-2e62aeb5-cb92-4078-85b0-5b3e1c209faf" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:04:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Lock "cinder-quobyte-2e62aeb5-cb92-4078-85b0-5b3e1c209faf" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:04:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdbb23f-fe11-4277-a1e2-a74225a2edcd]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:04:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:31 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf Jul 29 16:04:31 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:32 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf" returned: 0 in 0.695s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:32 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf Jul 29 16:04:32 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:32 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2e62aeb5-cb92-4078-85b0-5b3e1c209faf" returned: 0 in 0.375s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Lock "cinder-quobyte-2e62aeb5-cb92-4078-85b0-5b3e1c209faf" released by "delete_volume" :: held 1.186s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Created reservations ['1419e758-40ef-4ff0-adef-4abd91705777', 'dd61f833-f27f-4d2c-bc52-4dba9164c544', 'fac8d38c-b8d9-4f98-9c4c-3e5abf6a2288', '05b5db25-91de-4e7c-98ac-d981ba7de508'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:33 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:04:33 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:33 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:04:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Deleted volume successfully. Jul 29 16:04:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e61facb9-d7ac-4aa4-a4b9-ce1c8832c726 tempest-DeleteServersTestJSON-1614047414 None] Lock "cinder-2e62aeb5-cb92-4078-85b0-5b3e1c209faf-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:04:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:04:36 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:04:36 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:04:37 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jul 29 16:04:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.432s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:04:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:04:43 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=53,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:04:43 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=46,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:04:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-15f6a3fb-af37-4ad4-9daf-a1ade3c28887 req-b8b19bc1-afbf-4156-a716-c86e3974f166 tempest-AttachVolumeTestJSON-1505021882 None] Terminate volume connection completed successfully. Jul 29 16:04:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-15f6a3fb-af37-4ad4-9daf-a1ade3c28887 req-b8b19bc1-afbf-4156-a716-c86e3974f166 tempest-AttachVolumeTestJSON-1505021882 None] Deleting attachment 765e66e9-dfbc-4bc9-9fe2-09c9bf47aee8. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:05:07 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:05:07 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Flow 'volume_create_manager' (07e449c3-7f50-4806-8159-74bfe248f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbe2612-eb55-456b-82b5-1a03b7e8ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbe2612-eb55-456b-82b5-1a03b7e8ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-977161475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c687ccdf-8e29-4dcf-b57c-a758f93bb82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc158a235da42ff8474068f480a2fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:05:22Z,use_quota=True,user_id='da1f2fb100234525b45e5d18d5efef3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7dbc52-9da2-47e1-9e95-82d84bcbe36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7dbc52-9da2-47e1-9e95-82d84bcbe36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad868025-4978-47b7-994d-fb1eb2d42985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad868025-4978-47b7-994d-fb1eb2d42985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c687ccdf-8e29-4dcf-b57c-a758f93bb82d', 'volume_name': 'volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1f4acf-20d3-4f34-abcb-a2161e079936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1f4acf-20d3-4f34-abcb-a2161e079936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ca3dc-e506-4e6a-8b2a-b3a287be258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Volume c687ccdf-8e29-4dcf-b57c-a758f93bb82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d', 'volume_size': 1} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-977161475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c687ccdf-8e29-4dcf-b57c-a758f93bb82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc158a235da42ff8474068f480a2fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:05:22Z,use_quota=True,user_id='da1f2fb100234525b45e5d18d5efef3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Creating volume c687ccdf-8e29-4dcf-b57c-a758f93bb82d {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:05:22 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:05:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:22 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d 1073741824 Jul 29 16:05:22 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:23 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d 1073741824" returned: 0 in 1.040s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:23 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d Jul 29 16:05:23 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:24 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d" returned: 0 in 0.491s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ca3dc-e506-4e6a-8b2a-b3a287be258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4399e2-d860-46e2-8035-b07048101e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Volume volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d (c687ccdf-8e29-4dcf-b57c-a758f93bb82d): created successfully Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4399e2-d860-46e2-8035-b07048101e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Flow 'volume_create_manager' (07e449c3-7f50-4806-8159-74bfe248f914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:05:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b5f0cb29-2409-4400-b179-8915f6095eea tempest-ServerRescueNegativeTestJSON-2094409545 None] Created volume successfully. Jul 29 16:05:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:05:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:36 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:05:36 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:37 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 1.006s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:05:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Acquiring lock "cinder-c687ccdf-8e29-4dcf-b57c-a758f93bb82d-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:05:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "cinder-c687ccdf-8e29-4dcf-b57c-a758f93bb82d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:05:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Acquiring lock "cinder-quobyte-c687ccdf-8e29-4dcf-b57c-a758f93bb82d" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:05:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "cinder-quobyte-c687ccdf-8e29-4dcf-b57c-a758f93bb82d" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:05:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf8209e-6212-420f-a579-9a43d33e8b09]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:05:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:43 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d Jul 29 16:05:43 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:44 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d" returned: 0 in 0.413s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:44 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d Jul 29 16:05:44 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:44 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c687ccdf-8e29-4dcf-b57c-a758f93bb82d" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "cinder-quobyte-c687ccdf-8e29-4dcf-b57c-a758f93bb82d" released by "delete_volume" :: held 0.760s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Created reservations ['f9f49580-37e4-4965-88f3-8a2b54e601dd', '32a25c55-fd10-43fb-9333-651401ac7509', 'd4ab4b73-4694-45d4-9af7-d5b88be99ff0', '6a73e52a-cb7f-4afd-bff4-538ba41ac717'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:44 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:05:44 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:45 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.404s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:45 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:05:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Deleted volume successfully. Jul 29 16:05:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2ab2dad-675e-49f7-b081-a15f331a1360 tempest-ServerRescueNegativeTestJSON-2094409545 None] Lock "cinder-c687ccdf-8e29-4dcf-b57c-a758f93bb82d-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:05:45 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:05:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Flow 'volume_create_manager' (93976163-6b2a-4977-82e8-8380fbacc325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:05:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150b3310-fff2-40fd-a4aa-4100a50771fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150b3310-fff2-40fd-a4aa-4100a50771fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-470677559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3411d813-ae29-44ed-91d6-8278a789539e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21917c6ca8e34ae3a290f4e2f77338e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:05:46Z,use_quota=True,user_id='7fc7f1a9f897423b8a732b0985a00a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddaf6c2-056a-43d5-90c1-9318309150a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddaf6c2-056a-43d5-90c1-9318309150a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ee6e45-c296-436c-bda6-fcd48f8db0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ee6e45-c296-436c-bda6-fcd48f8db0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3411d813-ae29-44ed-91d6-8278a789539e', 'volume_name': 'volume-3411d813-ae29-44ed-91d6-8278a789539e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a4c1b-1506-4bdb-8d66-d663492654ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a4c1b-1506-4bdb-8d66-d663492654ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d1f867-a1a3-4c13-9803-b01fe4959e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:46 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Volume 3411d813-ae29-44ed-91d6-8278a789539e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3411d813-ae29-44ed-91d6-8278a789539e', 'volume_size': 1} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-470677559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3411d813-ae29-44ed-91d6-8278a789539e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21917c6ca8e34ae3a290f4e2f77338e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:05:46Z,use_quota=True,user_id='7fc7f1a9f897423b8a732b0985a00a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Creating volume 3411d813-ae29-44ed-91d6-8278a789539e {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:05:46 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:46 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e 1073741824 Jul 29 16:05:46 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:46 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e 1073741824" returned: 0 in 0.654s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:46 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e Jul 29 16:05:46 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:47 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e" returned: 0 in 0.320s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d1f867-a1a3-4c13-9803-b01fe4959e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3411d813-ae29-44ed-91d6-8278a789539e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c7e3ce-9ded-420a-a6a0-55880712d3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:47 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Volume volume-3411d813-ae29-44ed-91d6-8278a789539e (3411d813-ae29-44ed-91d6-8278a789539e): created successfully Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c7e3ce-9ded-420a-a6a0-55880712d3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Flow 'volume_create_manager' (93976163-6b2a-4977-82e8-8380fbacc325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:05:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ff07533b-37b2-4f9a-b870-328dea39b729 tempest-ServersNegativeTestJSON-257086297 None] Created volume successfully. Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Flow 'volume_create_manager' (2a1b99de-758f-4303-9200-3f820cdb3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58df9863-d717-4f0b-b0cf-91e2c3e30ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58df9863-d717-4f0b-b0cf-91e2c3e30ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-955396546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad86391-2b0a-4fb3-9c32-44dea60bf6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21917c6ca8e34ae3a290f4e2f77338e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:05:50Z,use_quota=True,user_id='7fc7f1a9f897423b8a732b0985a00a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a77714-8d26-44a5-9ba4-8f01ca8a3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a77714-8d26-44a5-9ba4-8f01ca8a3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3508a94d-f0ee-45fe-9a91-9118cbba2dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3508a94d-f0ee-45fe-9a91-9118cbba2dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad86391-2b0a-4fb3-9c32-44dea60bf6f1', 'volume_name': 'volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a107dd1c-dc1f-4490-ae37-1462910d33a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a107dd1c-dc1f-4490-ae37-1462910d33a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dc16b6-b1de-4f35-8def-33a4d2208fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:49 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Volume 2ad86391-2b0a-4fb3-9c32-44dea60bf6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1', 'volume_size': 1} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-955396546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad86391-2b0a-4fb3-9c32-44dea60bf6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21917c6ca8e34ae3a290f4e2f77338e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:05:50Z,use_quota=True,user_id='7fc7f1a9f897423b8a732b0985a00a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Creating volume 2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:05:49 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:05:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:49 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 1073741824 Jul 29 16:05:49 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:50 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 1073741824" returned: 0 in 0.594s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:50 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 Jul 29 16:05:50 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:50 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1" returned: 0 in 0.316s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dc16b6-b1de-4f35-8def-33a4d2208fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf6c5bc-5e20-493a-b024-c1c01d66ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:05:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Volume volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 (2ad86391-2b0a-4fb3-9c32-44dea60bf6f1): created successfully Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf6c5bc-5e20-493a-b024-c1c01d66ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:05:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Flow 'volume_create_manager' (2a1b99de-758f-4303-9200-3f820cdb3759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:05:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-bea97287-ca91-464b-bd62-ad3e9a8f9cbc tempest-ServersNegativeTestJSON-257086297 None] Created volume successfully. Jul 29 16:05:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "cinder-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:05:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:05:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "cinder-quobyte-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:05:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-quobyte-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:05:52 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc5b64-7d57-4a36-b326-0fa4ce3eb896]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:05:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:52 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 Jul 29 16:05:52 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:53 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1" returned: 0 in 0.467s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:53 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1 Jul 29 16:05:53 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:53 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1" returned: 0 in 0.318s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-quobyte-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1" released by "delete_volume" :: held 0.837s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Created reservations ['4d8210d0-8af5-4b88-9fd3-8a3bfcfc1b42', 'c883bf76-d296-41bc-bcfa-9f6be574e26a', 'f690e8ad-5fd9-463d-a4a1-d327b273b9d8', '9da1beae-4e5b-46a0-a654-d0b587332e9a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:53 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:05:53 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "cinder-3411d813-ae29-44ed-91d6-8278a789539e-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-3411d813-ae29-44ed-91d6-8278a789539e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "cinder-quobyte-3411d813-ae29-44ed-91d6-8278a789539e" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-quobyte-3411d813-ae29-44ed-91d6-8278a789539e" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e5f37a-72cc-42f8-9fc5-d45aaddcbf9a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:53 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.448s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:53 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:05:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Deleted volume successfully. Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7712efc3-166e-4758-8d4e-ba5c391dc305 tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-2ad86391-2b0a-4fb3-9c32-44dea60bf6f1-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:05:54 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e Jul 29 16:05:54 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:54 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e" returned: 0 in 0.456s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:54 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e Jul 29 16:05:54 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:54 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3411d813-ae29-44ed-91d6-8278a789539e" returned: 0 in 0.313s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-quobyte-3411d813-ae29-44ed-91d6-8278a789539e" released by "delete_volume" :: held 0.828s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Created reservations ['b36e3285-5d28-4f37-afd7-d8762e3a98eb', 'da10ce64-5097-472e-8be1-3afceab90644', '3168a2bb-493e-4930-8fe8-36223fc271ff', '881b6d50-31be-47ae-bb2b-d7eb71ecc344'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:05:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:05:54 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:05:54 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:05:55 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 29 16:05:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.316s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:05:55 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:05:55 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Deleted volume successfully. Jul 29 16:05:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4209e7a7-0590-45ee-a8fa-47e46b8510dd tempest-ServersNegativeTestJSON-257086297 None] Lock "cinder-3411d813-ae29-44ed-91d6-8278a789539e-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Flow 'volume_create_manager' (a411975e-ce35-43ac-90cb-932c7574f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba99fa3-1259-44cb-a4fb-af692a3972df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba99fa3-1259-44cb-a4fb-af692a3972df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1931129064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99bb84a1b65a4ff791828303f4317b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:01Z,use_quota=True,user_id='354a934d132343758d2be65a2a3db969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8080c1-607a-4e75-8152-e344c783ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8080c1-607a-4e75-8152-e344c783ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e1f801-37b8-470a-8ad0-a7a981de890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e1f801-37b8-470a-8ad0-a7a981de890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c', 'volume_name': 'volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8293006-3914-43fd-bdf5-c408f43b0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8293006-3914-43fd-bdf5-c408f43b0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a11efb-d39e-47b0-93b5-8e81f27d3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Volume 0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c', 'volume_size': 1} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1931129064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99bb84a1b65a4ff791828303f4317b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:01Z,use_quota=True,user_id='354a934d132343758d2be65a2a3db969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Creating volume 0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:01 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:01 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c 1073741824 Jul 29 16:06:01 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:01 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c 1073741824" returned: 0 in 0.638s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:01 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c Jul 29 16:06:01 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:02 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c" returned: 0 in 0.466s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a11efb-d39e-47b0-93b5-8e81f27d3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9d2b6c-903f-497f-a838-ea5e3995964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:02 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Volume volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c (0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c): created successfully Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9d2b6c-903f-497f-a838-ea5e3995964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Flow 'volume_create_manager' (a411975e-ce35-43ac-90cb-932c7574f3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-917cf3ee-dcb0-44a5-9474-bf3d44d465d7 req-b48b4d32-a219-48bb-a220-f6b81b25e581 tempest-VolumesGetTestJSON-1384834290 None] Created volume successfully. Jul 29 16:06:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Acquiring lock "cinder-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Lock "cinder-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Acquiring lock "cinder-quobyte-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Lock "cinder-quobyte-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f73d040-6b6c-4b2a-9f3a-eb1fcd6bec88]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:04 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c Jul 29 16:06:04 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:04 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c" returned: 0 in 0.507s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:04 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c Jul 29 16:06:04 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:04 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Lock "cinder-quobyte-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c" released by "delete_volume" :: held 0.870s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG cinder.quota [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Created reservations ['9ae0c3ad-5a22-4899-b271-29fd5d4d4726', '7435d2e3-322d-4058-aafb-5f6f1a01462d', '358fdc60-4e87-4765-9fbf-e1c15b2db6e4', '2973bbaa-bf94-4a56-8d31-0f99299ee620'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:05 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:05 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:05 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:05 devstack cinder-volume[88575]: DEBUG cinder.manager [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Deleted volume successfully. Jul 29 16:06:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-ab881480-3218-4b28-ad28-0cb34fd00b53 req-a17fa7c1-8785-4850-a72a-67144ae17553 tempest-VolumesGetTestJSON-1384834290 None] Lock "cinder-0dba62aa-c2b9-48ff-9d5f-13ca2cb0640c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Flow 'volume_create_manager' (65b4a502-9191-49f6-b932-c5bc0661ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4705d083-b4cf-4bd8-8f9d-b380ae8505b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4705d083-b4cf-4bd8-8f9d-b380ae8505b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1852869084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1a080d-6485-4526-948c-1fe34a6bb7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425cf26f2662423d8d7f50a0664de585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:09Z,use_quota=True,user_id='7510b26c05254d389d865784b481e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad139582-b187-4ad0-8214-fbe08c85895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad139582-b187-4ad0-8214-fbe08c85895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845fde17-dc88-489b-b364-795402adc667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845fde17-dc88-489b-b364-795402adc667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1a080d-6485-4526-948c-1fe34a6bb7e2', 'volume_name': 'volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a724bdb-7922-4a7f-9dbf-bb876f2b8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a724bdb-7922-4a7f-9dbf-bb876f2b8cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9730c908-5251-4b0f-9157-48e23f8aafa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:09 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Volume fc1a080d-6485-4526-948c-1fe34a6bb7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2', 'volume_size': 1} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1852869084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1a080d-6485-4526-948c-1fe34a6bb7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425cf26f2662423d8d7f50a0664de585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:09Z,use_quota=True,user_id='7510b26c05254d389d865784b481e7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Creating volume fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:09 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:09 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 1073741824 Jul 29 16:06:09 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:10 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 1073741824" returned: 0 in 0.683s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:10 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 Jul 29 16:06:10 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:10 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2" returned: 0 in 0.415s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9730c908-5251-4b0f-9157-48e23f8aafa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64873a77-a9f5-455f-8050-228d81d82f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Volume volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 (fc1a080d-6485-4526-948c-1fe34a6bb7e2): created successfully Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64873a77-a9f5-455f-8050-228d81d82f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Flow 'volume_create_manager' (65b4a502-9191-49f6-b932-c5bc0661ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-7cb77008-09b0-4a29-a4b9-b6b101de3bdb req-e4f223b5-1e1e-4952-8cff-2129cbd80ae3 tempest-VolumesSnapshotsTestJSON-1464644795 None] Created volume successfully. Jul 29 16:06:12 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-99dc830e-89f1-423e-ae4e-fa689e45e242 tempest-GroupSnapshotsTest-831054771 None] Group tempest-GroupSnapshotsTest-Group-1740864027: creating Jul 29 16:06:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Creating offline snapshot 4bdb73fd-e737-42fe-a831-f1c6e30484ff of volume fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:06:12 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-99dc830e-89f1-423e-ae4e-fa689e45e242 tempest-GroupSnapshotsTest-831054771 None] Group tempest-GroupSnapshotsTest-Group-1740864027: created successfully Jul 29 16:06:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e2cd1-a1f8-4f94-9a3d-e90687fb3b35]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:12 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-99dc830e-89f1-423e-ae4e-fa689e45e242 tempest-GroupSnapshotsTest-831054771 None] Create group completed successfully. Jul 29 16:06:12 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 Jul 29 16:06:12 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:13 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2" returned: 0 in 0.398s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:13 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff 1G Jul 29 16:06:13 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:13 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff 1G" returned: 0 in 0.487s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:13 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff Jul 29 16:06:13 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:14 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff" returned: 0 in 0.402s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:14 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff is being set with open permissions: ugo+rw Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:14 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff Jul 29 16:06:14 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (8adf1d08-2821-4f09-80f8-5c026febafc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c767f771-fdd5-47dd-9e72-8e678ad00e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c767f771-fdd5-47dd-9e72-8e678ad00e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200414969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec7e7ef4-82c7-4d74-aeef-c35de6bfb057,host='devstack@QuobyteHD#QuobyteHD',id=ee97219f-2f76-4bca-a0bc-af6a9d069ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:14Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5767df45-9543-4d34-9301-4224437cb88b),volume_type_id=5767df45-9543-4d34-9301-4224437cb88b)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eefc10-bd9c-4a4a-a9a7-a77a1658ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eefc10-bd9c-4a4a-a9a7-a77a1658ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf17da6-7d67-488d-8913-a112a4a033a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf17da6-7d67-488d-8913-a112a4a033a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee97219f-2f76-4bca-a0bc-af6a9d069ed8', 'volume_name': 'volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88130f17-0f79-4e0c-a694-7f960103c2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88130f17-0f79-4e0c-a694-7f960103c2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093e8515-78fe-40ce-bc69-8ff4990666ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Volume ee97219f-2f76-4bca-a0bc-af6a9d069ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8', 'volume_size': 1} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:14 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:14 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info Jul 29 16:06:14 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:14 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info" returned: 0 in 0.271s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:14 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info is being set with open permissions: ugo+rw Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:14 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info Jul 29 16:06:14 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:14 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.info" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec7e7ef4-82c7-4d74-aeef-c35de6bfb057,created_at=2026-07-29T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200414969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec7e7ef4-82c7-4d74-aeef-c35de6bfb057,host='devstack@QuobyteHD#QuobyteHD',id=ee97219f-2f76-4bca-a0bc-af6a9d069ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:14Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5767df45-9543-4d34-9301-4224437cb88b),volume_type_id=5767df45-9543-4d34-9301-4224437cb88b)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Creating volume ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:14 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:14 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 1073741824 Jul 29 16:06:14 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-1276a4ae-ae62-4eb1-a197-96b9ecd1d4de req-64b5cfa2-d18e-4993-902b-4d7499e29bbb tempest-VolumesSnapshotsTestJSON-1464644795 None] Create snapshot completed successfully Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "cinder-4bdb73fd-e737-42fe-a831-f1c6e30484ff-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-4bdb73fd-e737-42fe-a831-f1c6e30484ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "cinder-quobyte-fc1a080d-6485-4526-948c-1fe34a6bb7e2" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-quobyte-fc1a080d-6485-4526-948c-1fe34a6bb7e2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "cinder-quobyte-4bdb73fd-e737-42fe-a831-f1c6e30484ff" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-quobyte-4bdb73fd-e737-42fe-a831-f1c6e30484ff" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Deleting offline snapshot 4bdb73fd-e737-42fe-a831-f1c6e30484ff of volume fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] snapshot_file for this snap is: volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d41bd1-5ea0-4f99-a18e-5d4389bc8b2d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:15 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff Jul 29 16:06:15 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:15 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 1073741824" returned: 0 in 0.580s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:15 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:15 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:15 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff" returned: 0 in 0.455s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f999488-6c5b-44b1-a0a6-46aad62c48a2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:15 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.285s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093e8515-78fe-40ce-bc69-8ff4990666ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dcdd12-b84e-41ad-b1a4-9eba4953a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Volume volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 (ee97219f-2f76-4bca-a0bc-af6a9d069ed8): created successfully Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dcdd12-b84e-41ad-b1a4-9eba4953a8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (8adf1d08-2821-4f09-80f8-5c026febafc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cb1211ef-5720-45dc-a2e0-3ef09cc5f789 tempest-GroupSnapshotsTest-831054771 None] Created volume successfully. Jul 29 16:06:15 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 Jul 29 16:06:15 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:16 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2" returned: 0 in 0.421s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:16 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff Jul 29 16:06:16 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:16 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff" returned: 0 in 0.395s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:16 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff Jul 29 16:06:16 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] GroupSnapshot 7af6b565-2ee2-44c2-b0dd-ffdd091b9924: creating. Jul 29 16:06:16 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2.4bdb73fd-e737-42fe-a831-f1c6e30484ff" returned: 0 in 0.362s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Group snapshot 7af6b565-2ee2-44c2-b0dd-ffdd091b9924: creating. {{(pid=88575) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-quobyte-4bdb73fd-e737-42fe-a831-f1c6e30484ff" released by "_delete_snapshot" :: held 1.785s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-quobyte-fc1a080d-6485-4526-948c-1fe34a6bb7e2" released by "delete_snapshot" :: held 1.833s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Creating offline snapshot e4d2d60c-2dbc-44a5-8eba-87277876df96 of volume ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ac727-5af6-4178-b63b-d9ad6ce72b35]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:17 devstack cinder-volume[88575]: WARNING cinder.quota [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.quota [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Created reservations ['084e074c-da58-4c78-8915-3670af07efae', '51ee915d-43b9-422f-9b4b-57716f6710ad', 'e8e6bc45-2291-4aab-8ca9-a90a6b6f8950', 'f01a0d8f-1ef4-412e-b0bd-349f96d94974'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Delete snapshot completed successfully. Jul 29 16:06:17 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:17 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-7a202e0d-4c88-4d1e-aef7-682487739e7e req-6b0603b1-8953-474a-8f33-c27c56dfc0ef tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-4bdb73fd-e737-42fe-a831-f1c6e30484ff-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "cinder-fc1a080d-6485-4526-948c-1fe34a6bb7e2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-fc1a080d-6485-4526-948c-1fe34a6bb7e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "cinder-quobyte-fc1a080d-6485-4526-948c-1fe34a6bb7e2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:17 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.475s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-quobyte-fc1a080d-6485-4526-948c-1fe34a6bb7e2" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:17 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 1G Jul 29 16:06:17 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97db808-aa8f-47af-a878-be2ac094e36a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:17 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 Jul 29 16:06:17 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:18 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 1G" returned: 0 in 0.501s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:18 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:18 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 Jul 29 16:06:18 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:18 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2 Jul 29 16:06:18 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:18 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1a080d-6485-4526-948c-1fe34a6bb7e2" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:18 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96" returned: 0 in 0.330s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:18 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-quobyte-fc1a080d-6485-4526-948c-1fe34a6bb7e2" released by "delete_volume" :: held 0.828s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:18 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 Jul 29 16:06:18 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG cinder.quota [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Created reservations ['c1e79c50-821c-4cac-ac4f-0cfa7be12a0f', 'ee12ef4b-cfd4-41c5-80e9-f87f947d5bb9', 'b0c40ea6-5271-49f9-b007-ded85a7c6800', '94275977-45cb-49a2-aa86-81ccec2d900a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:18 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:18 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:18 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96" returned: 0 in 0.326s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:18 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info Jul 29 16:06:18 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:18 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.351s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG cinder.manager [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Deleted volume successfully. Jul 29 16:06:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-dd3b59ad-04be-4448-9bea-ebe7b235a539 req-71bdd991-100c-4d9e-9c2c-f80a12b937e0 tempest-VolumesSnapshotsTestJSON-1464644795 None] Lock "cinder-fc1a080d-6485-4526-948c-1fe34a6bb7e2-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:19 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info" returned: 0 in 0.347s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:19 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:19 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info Jul 29 16:06:19 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:19 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.info" returned: 0 in 0.285s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a395f97f-57b9-4d53-a172-d74cc2de5327 tempest-GroupSnapshotsTest-831054771 None] group_snapshot 7af6b565-2ee2-44c2-b0dd-ffdd091b9924: created successfully Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-e4d2d60c-2dbc-44a5-8eba-87277876df96-6b02ea7e-98c1-4d32-8376-576d948832ae" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-e4d2d60c-2dbc-44a5-8eba-87277876df96-6b02ea7e-98c1-4d32-8376-576d948832ae" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Creating volume 6b02ea7e-98c1-4d32-8376-576d948832ae from snapshot e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-6b02ea7e-98c1-4d32-8376-576d948832ae" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-6b02ea7e-98c1-4d32-8376-576d948832ae" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] snapshot: e4d2d60c-2dbc-44a5-8eba-87277876df96, volume: 6b02ea7e-98c1-4d32-8376-576d948832ae, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8655147f-06d7-465f-b41b-d502776a3103]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:21 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 Jul 29 16:06:21 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:21 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcf29f3-0428-40ab-8de8-70e760759bae]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:21 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:21 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:22 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.435s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:22 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:06:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:22 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae Jul 29 16:06:22 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-73ff4183-3701-4269-b22d-2ef27c5419f4 tempest-BackendsCapabilitiesAdminTestsJSON-377905117 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7427024841309, 'free_capacity_gb': 1775.7427024841309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88575) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 29 16:06:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2321a88b-93e9-48c0-94df-3486cb0fdc53 tempest-BackendsCapabilitiesAdminTestsJSON-377905117 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7427024841309, 'free_capacity_gb': 1775.7427024841309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88575) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 29 16:06:27 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae" returned: 0 in 5.221s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ad681b-f3e5-49b7-ac33-c06273ecbbb1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:27 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:27 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:28 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.683s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:06:28 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Converted 1024.00 MB image at 196.06 MB/s Jul 29 16:06:28 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:28 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae Jul 29 16:06:28 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:28 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae" returned: 0 in 0.307s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-6b02ea7e-98c1-4d32-8376-576d948832ae" released by "_copy_volume_from_snapshot" :: held 7.299s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-e4d2d60c-2dbc-44a5-8eba-87277876df96-6b02ea7e-98c1-4d32-8376-576d948832ae" released by "_create_volume_from_snapshot" :: held 7.345s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.374s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-472be6f9-a199-4fc7-bdc2-42b7e2d8e692 tempest-GroupSnapshotsTest-831054771 None] Create group from source-snapshot-7af6b565-2ee2-44c2-b0dd-ffdd091b9924 completed successfully. Jul 29 16:06:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-6b02ea7e-98c1-4d32-8376-576d948832ae" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-6b02ea7e-98c1-4d32-8376-576d948832ae" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:29 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad91d9-be6e-401b-bfe2-b97e28f4c5d8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:29 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae Jul 29 16:06:29 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:30 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae" returned: 0 in 0.386s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:30 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae Jul 29 16:06:30 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:30 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6b02ea7e-98c1-4d32-8376-576d948832ae" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-6b02ea7e-98c1-4d32-8376-576d948832ae" released by "delete_volume" :: held 0.720s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Created reservations ['be93dac4-c8dc-43a9-8603-d7f965b3ea69'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:30 devstack cinder-volume[88575]: WARNING cinder.quota [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1851627554 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1851627554, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:06:30 devstack cinder-volume[88575]: WARNING cinder.quota [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1851627554 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1851627554, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Created reservations ['dd7cf683-77c7-4165-b2ad-df2a6b9d8113', '75c107c6-1a88-463b-9e07-507437abcf55', 'f7e7c434-16c9-4a23-aa7b-caed128fbd45', '19b99da2-6120-4c02-8f8d-25a270fb27eb'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:30 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:30 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:30 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:30 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1611ffaa-f0f0-4ee4-bbf5-85de2e96deb2 tempest-GroupSnapshotsTest-831054771 None] Delete group completed successfully. Jul 29 16:06:30 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] group_snapshot 7af6b565-2ee2-44c2-b0dd-ffdd091b9924: deleting Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] group_snapshot 7af6b565-2ee2-44c2-b0dd-ffdd091b9924: deleting {{(pid=88575) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 29 16:06:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-e4d2d60c-2dbc-44a5-8eba-87277876df96" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-e4d2d60c-2dbc-44a5-8eba-87277876df96" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Deleting offline snapshot e4d2d60c-2dbc-44a5-8eba-87277876df96 of volume ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] snapshot_file for this snap is: volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f858afb-e72f-4a45-a0f6-b693fa5c148e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:31 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 Jul 29 16:06:31 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:31 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96" returned: 0 in 0.409s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c996250-047e-40b6-8a3d-5f16e768ddc7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:31 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:31 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:31 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.446s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:31 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 Jul 29 16:06:31 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Flow 'volume_create_manager' (bc64e0ac-da9f-43c3-a1bf-1bbc3b82a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfddd4ef-a5ec-44f1-9438-ec0eeafc8f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfddd4ef-a5ec-44f1-9438-ec0eeafc8f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218960055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474d39e2-6781-4d4f-b9fe-6513097572f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6898c7518c3849259806db7ea6d7df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:32Z,use_quota=True,user_id='7654d96dc8c94e18aed148b85ed83f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf46cbc-8c95-41bc-bebe-c8196040fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf46cbc-8c95-41bc-bebe-c8196040fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:32 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9af61f-f823-4fa9-ac15-e5d1b1e54939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9af61f-f823-4fa9-ac15-e5d1b1e54939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474d39e2-6781-4d4f-b9fe-6513097572f3', 'volume_name': 'volume-474d39e2-6781-4d4f-b9fe-6513097572f3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c965cc9c-ba46-431a-afb2-a1bb3f1ed5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c965cc9c-ba46-431a-afb2-a1bb3f1ed5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b1db2b-9d14-492e-81d3-fa7101551156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:32 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Volume 474d39e2-6781-4d4f-b9fe-6513097572f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474d39e2-6781-4d4f-b9fe-6513097572f3', 'volume_size': 1} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218960055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474d39e2-6781-4d4f-b9fe-6513097572f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6898c7518c3849259806db7ea6d7df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:32Z,use_quota=True,user_id='7654d96dc8c94e18aed148b85ed83f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Creating volume 474d39e2-6781-4d4f-b9fe-6513097572f3 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:32 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96" returned: 0 in 0.562s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:32 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 1073741824 Jul 29 16:06:32 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:32 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96 Jul 29 16:06:32 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:32 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8.e4d2d60c-2dbc-44a5-8eba-87277876df96" returned: 0 in 0.279s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-e4d2d60c-2dbc-44a5-8eba-87277876df96" released by "_delete_snapshot" :: held 1.815s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" released by "delete_snapshot" :: held 1.842s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:32 devstack cinder-volume[88575]: WARNING cinder.quota [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1851627554 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1851627554, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:06:32 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] Created reservations ['dc65068e-dc87-42e8-8b2a-c6a78298c7d3', '471ded5a-92ea-4adb-813f-2ebeb8efdc5c', '11f7634a-6cc8-483e-9ea4-e45eade731b7', '80d77875-f53e-4fae-9155-f709bd2f6bc7'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:33 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 1073741824" returned: 0 in 0.516s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ba251e80-cbfb-4641-9195-be4dff797daf tempest-GroupSnapshotsTest-831054771 None] group_snapshot 7af6b565-2ee2-44c2-b0dd-ffdd091b9924: deleted successfully Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:33 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 Jul 29 16:06:33 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:33 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3" returned: 0 in 0.281s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b1db2b-9d14-492e-81d3-fa7101551156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474d39e2-6781-4d4f-b9fe-6513097572f3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37d8da6-2a55-48e8-be1d-0d2f5acc2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Volume volume-474d39e2-6781-4d4f-b9fe-6513097572f3 (474d39e2-6781-4d4f-b9fe-6513097572f3): created successfully Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37d8da6-2a55-48e8-be1d-0d2f5acc2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Flow 'volume_create_manager' (bc64e0ac-da9f-43c3-a1bf-1bbc3b82a490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0e50ddec-2efc-4adf-8a49-02addf6bf93a tempest-AttachVolumeTestJSON-1505021882 None] Created volume successfully. Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c572b-6c44-4db5-809d-1391978cfcf2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:33 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:33 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:34 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.419s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:34 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8 Jul 29 16:06:34 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:34 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" returned: 0 in 0.279s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-ee97219f-2f76-4bca-a0bc-af6a9d069ed8" released by "delete_volume" :: held 0.793s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=81,cinder:INSERT=22,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=95,cinder:SELECT=72,cinder:INSERT=19,cinder:DELETE=6 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Created reservations ['1a9822c8-9f92-4895-8de3-791fba03ad9d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:34 devstack cinder-volume[88575]: WARNING cinder.db.sqlalchemy.api [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1851627554'] Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Created reservations ['b4ba3956-5d8a-4d24-9b30-5d0f96dc7417', 'efe7faa6-2798-4a65-8423-e8ed1f232b3f', '73d8a539-b07f-4b65-ad9c-0c381d20d9e6', 'f296d877-0fb9-4a73-929a-76c8e9c44332'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:34 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:34 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:35 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.448s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:35 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-507aec48-33af-4415-8b62-9548977e7c2a tempest-GroupSnapshotsTest-831054771 None] Delete group completed successfully. Jul 29 16:06:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-710bd56f-dbcf-410b-84a4-381f391d209e tempest-GroupSnapshotsTest-831054771 None] Group tempest-GroupSnapshotsTest-Group-805360033: creating Jul 29 16:06:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-710bd56f-dbcf-410b-84a4-381f391d209e tempest-GroupSnapshotsTest-831054771 None] Group tempest-GroupSnapshotsTest-Group-805360033: created successfully Jul 29 16:06:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-710bd56f-dbcf-410b-84a4-381f391d209e tempest-GroupSnapshotsTest-831054771 None] Create group completed successfully. Jul 29 16:06:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-eef2de64-9397-458e-902a-4be80f04075b req-7f5d723e-08fb-41d5-ba9f-270dba9c328d tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-eef2de64-9397-458e-902a-4be80f04075b req-7f5d723e-08fb-41d5-ba9f-270dba9c328d tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-eef2de64-9397-458e-902a-4be80f04075b req-7f5d723e-08fb-41d5-ba9f-270dba9c328d tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-eef2de64-9397-458e-902a-4be80f04075b req-7f5d723e-08fb-41d5-ba9f-270dba9c328d tempest-AttachVolumeTestJSON-1505021882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-474d39e2-6781-4d4f-b9fe-6513097572f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9817eb3-f64c-49bd-bf81-2827d66ee093', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:06:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-eef2de64-9397-458e-902a-4be80f04075b req-7f5d723e-08fb-41d5-ba9f-270dba9c328d tempest-AttachVolumeTestJSON-1505021882 None] attachment_update completed successfully. Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (f265b080-78d6-4a1c-b1b9-b09517259ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ba4889-d6ee-4b3a-b5b5-7a7b4d3a21be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ba4889-d6ee-4b3a-b5b5-7a7b4d3a21be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232263882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=957e1501-f6c3-40b5-bb4f-cd4c17528d8d,host='devstack@QuobyteHD#QuobyteHD',id=d748fcec-11a6-461d-81b6-bc14ca5ae755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:37Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40433109-11c1-468e-a7c0-518c57120b3c),volume_type_id=40433109-11c1-468e-a7c0-518c57120b3c)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd5cdc1-f908-4b7a-b5eb-90742324bb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd5cdc1-f908-4b7a-b5eb-90742324bb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeed5163-8f48-44b7-922a-261e38735d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeed5163-8f48-44b7-922a-261e38735d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd748fcec-11a6-461d-81b6-bc14ca5ae755', 'volume_name': 'volume-d748fcec-11a6-461d-81b6-bc14ca5ae755', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a25f1d8-65e4-477d-94a4-635d2006454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a25f1d8-65e4-477d-94a4-635d2006454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a82f037-bc21-4c9c-9513-b2d7b9a7edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Volume d748fcec-11a6-461d-81b6-bc14ca5ae755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d748fcec-11a6-461d-81b6-bc14ca5ae755', 'volume_size': 1} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=957e1501-f6c3-40b5-bb4f-cd4c17528d8d,created_at=2026-07-29T14:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232263882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=957e1501-f6c3-40b5-bb4f-cd4c17528d8d,host='devstack@QuobyteHD#QuobyteHD',id=d748fcec-11a6-461d-81b6-bc14ca5ae755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:37Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40433109-11c1-468e-a7c0-518c57120b3c),volume_type_id=40433109-11c1-468e-a7c0-518c57120b3c)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Creating volume d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:37 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:37 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 1073741824 Jul 29 16:06:37 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:38 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 1073741824" returned: 0 in 0.594s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:38 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 Jul 29 16:06:38 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:38 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755" returned: 0 in 0.299s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a82f037-bc21-4c9c-9513-b2d7b9a7edf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d748fcec-11a6-461d-81b6-bc14ca5ae755', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a8472f-d402-4498-bf7c-5a397d70be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Volume volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 (d748fcec-11a6-461d-81b6-bc14ca5ae755): created successfully Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a8472f-d402-4498-bf7c-5a397d70be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (f265b080-78d6-4a1c-b1b9-b09517259ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Flow 'volume_create_manager' (1a1a415b-63c4-4e95-9fd5-3b2eedb9c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7eb80f-89fd-41fa-af4c-66ec34822449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-98d3c587-f98b-48b5-a7c0-63b18e9f02b5 tempest-GroupSnapshotsTest-831054771 None] Created volume successfully. Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7eb80f-89fd-41fa-af4c-66ec34822449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1572620093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec26159-7128-49e0-bdb8-474896b99aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6898c7518c3849259806db7ea6d7df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:39Z,use_quota=True,user_id='7654d96dc8c94e18aed148b85ed83f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef0913c-5880-4e95-9df9-f4f22370b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef0913c-5880-4e95-9df9-f4f22370b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593133ff-8fc5-4a70-bc68-80850dea2ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593133ff-8fc5-4a70-bc68-80850dea2ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec26159-7128-49e0-bdb8-474896b99aad', 'volume_name': 'volume-6ec26159-7128-49e0-bdb8-474896b99aad', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f6d6ff-21c2-457c-88e5-765b778a9055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f6d6ff-21c2-457c-88e5-765b778a9055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ef4d90-27b6-441d-a028-da51268e490d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Volume 6ec26159-7128-49e0-bdb8-474896b99aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec26159-7128-49e0-bdb8-474896b99aad', 'volume_size': 1} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1572620093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec26159-7128-49e0-bdb8-474896b99aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6898c7518c3849259806db7ea6d7df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:39Z,use_quota=True,user_id='7654d96dc8c94e18aed148b85ed83f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Creating volume 6ec26159-7128-49e0-bdb8-474896b99aad {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:38 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:38 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad 1073741824 Jul 29 16:06:38 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:39 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad 1073741824" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:39 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad Jul 29 16:06:39 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:39 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ef4d90-27b6-441d-a028-da51268e490d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec26159-7128-49e0-bdb8-474896b99aad', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62eb030a-21f2-4fc8-bdb0-efd37e861791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:39 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Volume volume-6ec26159-7128-49e0-bdb8-474896b99aad (6ec26159-7128-49e0-bdb8-474896b99aad): created successfully Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62eb030a-21f2-4fc8-bdb0-efd37e861791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Flow 'volume_create_manager' (1a1a415b-63c4-4e95-9fd5-3b2eedb9c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:39 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-625b82ef-ec69-4aae-8ec9-25c7ed28e450 tempest-AttachVolumeTestJSON-1505021882 None] Created volume successfully. Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (5cec9e4c-5dab-4a20-8bdb-756dbd8ce88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5704740-bfec-4f58-af38-8b23f2fcfa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5704740-bfec-4f58-af38-8b23f2fcfa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763377424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=957e1501-f6c3-40b5-bb4f-cd4c17528d8d,host='devstack@QuobyteHD#QuobyteHD',id=19259d9a-b954-4f39-8c91-c74a38a50530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:40Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40433109-11c1-468e-a7c0-518c57120b3c),volume_type_id=40433109-11c1-468e-a7c0-518c57120b3c)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0cadf8-aefd-4e30-afa5-95316588dc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0cadf8-aefd-4e30-afa5-95316588dc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285c0130-beb6-4c65-8a87-1cf444113808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285c0130-beb6-4c65-8a87-1cf444113808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19259d9a-b954-4f39-8c91-c74a38a50530', 'volume_name': 'volume-19259d9a-b954-4f39-8c91-c74a38a50530', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541e7617-b2a1-416e-abe9-a97f6b13299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541e7617-b2a1-416e-abe9-a97f6b13299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41470d3f-7220-4220-af6f-086589aa2442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Volume 19259d9a-b954-4f39-8c91-c74a38a50530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19259d9a-b954-4f39-8c91-c74a38a50530', 'volume_size': 1} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=957e1501-f6c3-40b5-bb4f-cd4c17528d8d,created_at=2026-07-29T14:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763377424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=957e1501-f6c3-40b5-bb4f-cd4c17528d8d,host='devstack@QuobyteHD#QuobyteHD',id=19259d9a-b954-4f39-8c91-c74a38a50530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:06:40Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40433109-11c1-468e-a7c0-518c57120b3c),volume_type_id=40433109-11c1-468e-a7c0-518c57120b3c)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Creating volume 19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:06:40 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:06:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:40 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 1073741824 Jul 29 16:06:40 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:41 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 1073741824" returned: 0 in 0.577s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:41 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 Jul 29 16:06:41 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-3436da0c-eeea-4bd1-9334-268d23613d73 req-045ee89b-8d09-4eae-ba52-4e5d3f23f868 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:41 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-3436da0c-eeea-4bd1-9334-268d23613d73 req-045ee89b-8d09-4eae-ba52-4e5d3f23f868 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.199s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-3436da0c-eeea-4bd1-9334-268d23613d73 req-045ee89b-8d09-4eae-ba52-4e5d3f23f868 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41470d3f-7220-4220-af6f-086589aa2442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19259d9a-b954-4f39-8c91-c74a38a50530', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb20d7a-313f-4b5f-a673-57f197bdcb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:06:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Volume volume-19259d9a-b954-4f39-8c91-c74a38a50530 (19259d9a-b954-4f39-8c91-c74a38a50530): created successfully Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb20d7a-313f-4b5f-a673-57f197bdcb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (5cec9e4c-5dab-4a20-8bdb-756dbd8ce88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:06:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e1dc7d11-f455-402e-a8ed-1f103a386d8c tempest-GroupSnapshotsTest-831054771 None] Created volume successfully. Jul 29 16:06:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-3436da0c-eeea-4bd1-9334-268d23613d73 req-045ee89b-8d09-4eae-ba52-4e5d3f23f868 tempest-AttachVolumeTestJSON-1505021882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-6ec26159-7128-49e0-bdb8-474896b99aad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04e70cdc-cc79-4c69-a5d6-f1b79af9c3f0', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:06:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-3436da0c-eeea-4bd1-9334-268d23613d73 req-045ee89b-8d09-4eae-ba52-4e5d3f23f868 tempest-AttachVolumeTestJSON-1505021882 None] attachment_update completed successfully. Jul 29 16:06:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-51530f13-cadc-4d05-a7f1-3c1c301bb92c tempest-GroupSnapshotsTest-831054771 None] Update group completed successfully. Jul 29 16:06:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6e18068f-98dc-4eb5-ad5c-691ad7648f29 tempest-GroupSnapshotsTest-831054771 None] Update group completed successfully. Jul 29 16:06:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-dd313da4-17e0-480e-9b4a-75ad27d02534 tempest-GroupsV320Test-1751536525 None] Group tempest-GroupsV320Test-Group-201806531: creating Jul 29 16:06:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-325a26d9-71e8-4433-aa67-778c7ba7bf0b req-080f89b6-838c-4c25-94ea-4023c7f7b102 tempest-AttachVolumeTestJSON-1505021882 None] Terminate volume connection completed successfully. Jul 29 16:06:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-325a26d9-71e8-4433-aa67-778c7ba7bf0b req-080f89b6-838c-4c25-94ea-4023c7f7b102 tempest-AttachVolumeTestJSON-1505021882 None] Deleting attachment d9817eb3-f64c-49bd-bf81-2827d66ee093. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:06:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-dd313da4-17e0-480e-9b4a-75ad27d02534 tempest-GroupsV320Test-1751536525 None] Group tempest-GroupsV320Test-Group-201806531: created successfully Jul 29 16:06:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-dd313da4-17e0-480e-9b4a-75ad27d02534 tempest-GroupsV320Test-1751536525 None] Create group completed successfully. Jul 29 16:06:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f309c749-19c2-4361-ad21-f836488278b5 tempest-GroupSnapshotsTest-831054771 None] Update group completed successfully. Jul 29 16:06:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-9cf39f97-b0f8-473d-a88e-9f545cbcb555 req-09ed96ef-22b2-48b3-95b3-2bcbe7dfde77 tempest-AttachVolumeTestJSON-1505021882 None] Terminate volume connection completed successfully. Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-9cf39f97-b0f8-473d-a88e-9f545cbcb555 req-09ed96ef-22b2-48b3-95b3-2bcbe7dfde77 tempest-AttachVolumeTestJSON-1505021882 None] Deleting attachment 04e70cdc-cc79-4c69-a5d6-f1b79af9c3f0. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Created reservations ['d463d392-bb02-4444-b688-0ceca02e49b8'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:46 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:46 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:46 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:46 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4f583bdb-241e-4e57-99c5-74de5b9ca5ba tempest-GroupsV320Test-1751536525 None] Delete group completed successfully. Jul 29 16:06:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1e8cfc20-b183-4e7b-bcfa-b4e10886268a tempest-GroupSnapshotsTest-831054771 None] Update group completed successfully. Jul 29 16:06:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] GroupSnapshot 19b37ed0-4eaf-4a27-91dc-169bdb575917: creating. Jul 29 16:06:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Group snapshot 19b37ed0-4eaf-4a27-91dc-169bdb575917: creating. {{(pid=88575) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 29 16:06:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Creating offline snapshot e054f01f-0828-43ba-8503-abf6b1b1e4e1 of volume 19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:06:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc32812-1b62-4f6f-94da-f36bd233dfe5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:48 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 Jul 29 16:06:48 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:48 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530" returned: 0 in 0.492s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:49 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 1G Jul 29 16:06:49 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:49 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 1G" returned: 0 in 0.630s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19259d9a-b954-4f39-8c91-c74a38a50530 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:49 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19259d9a-b954-4f39-8c91-c74a38a50530 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 Jul 29 16:06:49 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:50 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19259d9a-b954-4f39-8c91-c74a38a50530 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:50 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:50 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 Jul 29 16:06:50 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:50 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:50 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info Jul 29 16:06:50 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:50 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info" returned: 0 in 0.283s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:50 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:50 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info Jul 29 16:06:50 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:50 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.info" returned: 0 in 0.307s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Creating offline snapshot f5075722-ae54-4c38-8fce-272ef98d6f06 of volume d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f8a53-2329-4834-bbb0-274772349a5a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:51 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 Jul 29 16:06:51 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:51 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755" returned: 0 in 0.444s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:51 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 1G Jul 29 16:06:51 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "cinder-6ec26159-7128-49e0-bdb8-474896b99aad-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-6ec26159-7128-49e0-bdb8-474896b99aad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "cinder-quobyte-6ec26159-7128-49e0-bdb8-474896b99aad" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-quobyte-6ec26159-7128-49e0-bdb8-474896b99aad" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdaf459-8f2a-46de-b686-2ca8209ec2d3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:52 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad Jul 29 16:06:52 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:52 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 1G" returned: 0 in 0.553s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:52 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 Jul 29 16:06:52 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:52 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:52 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad Jul 29 16:06:52 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:52 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06" returned: 0 in 0.324s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:52 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:52 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 Jul 29 16:06:52 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:52 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6ec26159-7128-49e0-bdb8-474896b99aad" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-quobyte-6ec26159-7128-49e0-bdb8-474896b99aad" released by "delete_volume" :: held 0.734s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:52 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:52 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info Jul 29 16:06:52 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Created reservations ['5e7f9f92-ee2e-4536-9d22-a064136d952c', '64c1aee8-5937-4bf4-838a-9f7283c59fbb', '2f4ec0a7-3119-4375-bf09-a67fa1ca0a29', '809a6374-cb63-4cb7-a70e-929638cfc0a5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:52 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:52 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:53 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info" returned: 0 in 0.327s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:53 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "cinder-474d39e2-6781-4d4f-b9fe-6513097572f3-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:53 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info Jul 29 16:06:53 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-474d39e2-6781-4d4f-b9fe-6513097572f3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:53 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.328s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Deleted volume successfully. Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-72fe557c-54ab-491c-8378-3c215d380401 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-6ec26159-7128-49e0-bdb8-474896b99aad-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "cinder-quobyte-474d39e2-6781-4d4f-b9fe-6513097572f3" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-quobyte-474d39e2-6781-4d4f-b9fe-6513097572f3" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:53 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.info" returned: 0 in 0.347s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e041ea-0f6f-4d08-a810-677fff5a38c3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:53 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 Jul 29 16:06:53 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d1828437-f144-49cc-9cc8-0d1476c0fef7 tempest-GroupSnapshotsTest-831054771 None] group_snapshot 19b37ed0-4eaf-4a27-91dc-169bdb575917: created successfully Jul 29 16:06:53 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3" returned: 0 in 0.396s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:53 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3 Jul 29 16:06:53 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] group_snapshot 19b37ed0-4eaf-4a27-91dc-169bdb575917: deleting Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] group_snapshot 19b37ed0-4eaf-4a27-91dc-169bdb575917: deleting {{(pid=88575) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-19259d9a-b954-4f39-8c91-c74a38a50530" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-19259d9a-b954-4f39-8c91-c74a38a50530" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-e054f01f-0828-43ba-8503-abf6b1b1e4e1" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-e054f01f-0828-43ba-8503-abf6b1b1e4e1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Deleting offline snapshot e054f01f-0828-43ba-8503-abf6b1b1e4e1 of volume 19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] snapshot_file for this snap is: volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66b1785-faf9-4b3d-a35e-2e26359d012a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:54 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-474d39e2-6781-4d4f-b9fe-6513097572f3" returned: 0 in 0.323s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-quobyte-474d39e2-6781-4d4f-b9fe-6513097572f3" released by "delete_volume" :: held 0.791s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:54 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 Jul 29 16:06:54 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Created reservations ['6e23cae2-0358-46db-97f7-be5b9a6ae86f', 'a6e381f1-258e-4074-88a6-f35727b634e9', '68f72c25-ee1a-42f3-bd8e-4ef59458cbb6', '2a36a6eb-2659-4e2f-9016-1ad7387ee39f'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:54 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:54 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:54 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1" returned: 0 in 0.455s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19259d9a-b954-4f39-8c91-c74a38a50530(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f37abd-48a0-47d4-acd5-fe41b596f476]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:54 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.285s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Deleted volume successfully. Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-720e2078-fa3a-4f76-b421-1c31ea88132d tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-474d39e2-6781-4d4f-b9fe-6513097572f3-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:54 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 Jul 29 16:06:54 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:54 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:55 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 Jul 29 16:06:55 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:55 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1" returned: 0 in 0.431s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:55 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1 Jul 29 16:06:55 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "cinder-1b3511f7-6a62-42b6-b283-9e5e910e5dc5-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-1b3511f7-6a62-42b6-b283-9e5e910e5dc5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "cinder-quobyte-1b3511f7-6a62-42b6-b283-9e5e910e5dc5" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-quobyte-1b3511f7-6a62-42b6-b283-9e5e910e5dc5" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[356df4bd-11f0-4cbe-b42e-95bc1b8d6ef4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:55 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530.e054f01f-0828-43ba-8503-abf6b1b1e4e1" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:55 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 Jul 29 16:06:55 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-e054f01f-0828-43ba-8503-abf6b1b1e4e1" released by "_delete_snapshot" :: held 1.822s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-19259d9a-b954-4f39-8c91-c74a38a50530" released by "delete_snapshot" :: held 1.860s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-d748fcec-11a6-461d-81b6-bc14ca5ae755" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-d748fcec-11a6-461d-81b6-bc14ca5ae755" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-f5075722-ae54-4c38-8fce-272ef98d6f06" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-f5075722-ae54-4c38-8fce-272ef98d6f06" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Deleting offline snapshot f5075722-ae54-4c38-8fce-272ef98d6f06 of volume d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] snapshot_file for this snap is: volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25ba07-1684-40fc-aef7-d2388fafd01c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:56 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 Jul 29 16:06:56 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:56 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:56 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5 Jul 29 16:06:56 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:56 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1b3511f7-6a62-42b6-b283-9e5e910e5dc5" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:56 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06" returned: 0 in 0.468s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d748fcec-11a6-461d-81b6-bc14ca5ae755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-quobyte-1b3511f7-6a62-42b6-b283-9e5e910e5dc5" released by "delete_volume" :: held 0.814s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3cd2cb-bccf-4455-b11a-c716594bc3a5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Created reservations ['502ebba0-0fa8-4317-a382-ec18819e19a4', 'e262db18-6548-4fa7-9028-de448de178f6', 'b1fb27ec-6055-4cdc-a352-7ecc4c397cc9', '8c8f574f-42a4-4f39-925b-331d4dbc9563'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:56 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 Jul 29 16:06:56 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:56 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:06:56 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:56 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755" returned: 0 in 0.509s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:56 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.320s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:56 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:06:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Deleted volume successfully. Jul 29 16:06:56 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 Jul 29 16:06:56 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e668dbcc-a64e-4639-ad47-ad3222f632c8 tempest-AttachVolumeTestJSON-1505021882 None] Lock "cinder-1b3511f7-6a62-42b6-b283-9e5e910e5dc5-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:57 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06" returned: 0 in 0.477s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:57 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06 Jul 29 16:06:57 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:57 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755.f5075722-ae54-4c38-8fce-272ef98d6f06" returned: 0 in 0.339s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-f5075722-ae54-4c38-8fce-272ef98d6f06" released by "_delete_snapshot" :: held 1.910s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-d748fcec-11a6-461d-81b6-bc14ca5ae755" released by "delete_snapshot" :: held 1.939s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:06:57 devstack cinder-volume[88575]: WARNING cinder.quota [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-403604889 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-403604889, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:06:57 devstack cinder-volume[88575]: WARNING cinder.quota [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-403604889 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-403604889, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:06:57 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Created reservations ['b952e6f9-31d4-4244-ab96-b1bdc44666ed', '4448ba99-012b-41d1-9c30-8ea22ae30f8e', 'c823931a-c49f-4625-9611-dc80dd6f9df1', '9a08a8af-9256-4889-b3a1-cae6b0417aab'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:58 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] Created reservations ['9c2739c8-ad33-453f-82b8-c2213abd5223', '720693da-84f1-42ce-a700-75900a5ad425', 'abe33612-410c-4fae-9ad3-bd4f28b295ba', '8360fcf3-6aa2-43f8-b57c-22e006da0ec2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:06:58 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-279f34e4-7e15-4ff1-8787-7d88418c3eef tempest-GroupSnapshotsTest-831054771 None] group_snapshot 19b37ed0-4eaf-4a27-91dc-169bdb575917: deleted successfully Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-19259d9a-b954-4f39-8c91-c74a38a50530" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-19259d9a-b954-4f39-8c91-c74a38a50530" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[351ecb70-d0c0-4eef-8de2-8f70a2fc2de7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:59 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 Jul 29 16:06:59 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:59 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530" returned: 0 in 0.479s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:06:59 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530 Jul 29 16:06:59 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:06:59 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 29 16:06:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19259d9a-b954-4f39-8c91-c74a38a50530" returned: 0 in 0.351s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-19259d9a-b954-4f39-8c91-c74a38a50530" released by "delete_volume" :: held 0.933s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-d748fcec-11a6-461d-81b6-bc14ca5ae755" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-d748fcec-11a6-461d-81b6-bc14ca5ae755" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1635daee-1332-43e4-b188-1d4c6ced7cee]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:00 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 Jul 29 16:07:00 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:00 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755" returned: 0 in 0.552s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:00 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755 Jul 29 16:07:00 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:00 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d748fcec-11a6-461d-81b6-bc14ca5ae755" returned: 0 in 0.308s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-d748fcec-11a6-461d-81b6-bc14ca5ae755" released by "delete_volume" :: held 0.943s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Created reservations ['5faed0b9-6e10-4b4c-bd46-6004002da6d0'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:01 devstack cinder-volume[88575]: WARNING cinder.quota [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-403604889 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-403604889, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Created reservations ['fecd7b63-ecd1-4b27-a7d5-a1837bc3ced8', '24d292ba-9529-4ed6-8fac-28cae57fd394', 'a5f3f4de-7894-4ec1-ad7b-eb87bbf219c3', '09fdb44c-b45d-4c2c-a986-f27d48de8814'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Created reservations ['e91cdace-6461-478a-aa05-429ac2cf8871', '4a8ad0b3-4375-4971-8e73-36516ffd869c', '9f556375-b5e8-4666-b3f8-9bb1818c54d0', '9675bbfe-d82d-4fe5-aaf9-95f07c7c2872'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:01 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:01 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:01 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.354s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:01 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:01 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-200ed376-be7b-4944-92c7-1eb39929d30f tempest-GroupSnapshotsTest-831054771 None] Delete group completed successfully. Jul 29 16:07:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b5570d22-8b28-4fcc-bcb8-1a93b265bfdd tempest-GroupSnapshotsTest-831054771 None] Group tempest-GroupSnapshotsTest-Group-2029638185: creating Jul 29 16:07:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b5570d22-8b28-4fcc-bcb8-1a93b265bfdd tempest-GroupSnapshotsTest-831054771 None] Group tempest-GroupSnapshotsTest-Group-2029638185: created successfully Jul 29 16:07:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b5570d22-8b28-4fcc-bcb8-1a93b265bfdd tempest-GroupSnapshotsTest-831054771 None] Create group completed successfully. Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Flow 'volume_create_manager' (1672b598-6716-4e27-a221-cb26a1bac5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e07b42-5259-45b2-9c5b-7355f78cdd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e07b42-5259-45b2-9c5b-7355f78cdd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1574477011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a325792-39c4-4e74-975b-fa22934a4792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb005e1713f74862a9fa3df1636724b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:03Z,use_quota=True,user_id='9d17f285a1dd455dbe47b0bebb090537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafe915e-c0f6-44ae-91a5-841064cfa052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafe915e-c0f6-44ae-91a5-841064cfa052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1af7755-1b2a-40ac-9f1d-a708fda1df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1af7755-1b2a-40ac-9f1d-a708fda1df95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a325792-39c4-4e74-975b-fa22934a4792', 'volume_name': 'volume-7a325792-39c4-4e74-975b-fa22934a4792', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd94bb2a-a2bd-452d-9988-0671181e6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd94bb2a-a2bd-452d-9988-0671181e6947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0bed53-6e83-4814-8c5b-28ffb9f6d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Volume 7a325792-39c4-4e74-975b-fa22934a4792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a325792-39c4-4e74-975b-fa22934a4792', 'volume_size': 1} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1574477011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a325792-39c4-4e74-975b-fa22934a4792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb005e1713f74862a9fa3df1636724b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:03Z,use_quota=True,user_id='9d17f285a1dd455dbe47b0bebb090537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Creating volume 7a325792-39c4-4e74-975b-fa22934a4792 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:03 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:03 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 1073741824 Jul 29 16:07:03 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (be96baf7-5911-476e-895e-c6ffe7399450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25565315-546b-49e1-95d5-ee7d2b36fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25565315-546b-49e1-95d5-ee7d2b36fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646950774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99532ffd-79f7-4a33-82ae-86e2b3259f2c,host='devstack@QuobyteHD#QuobyteHD',id=0920fdd1-fa38-4db1-9f34-7525c863d1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:04Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a165d686-abd5-408b-aeb8-6d0a37c148e1),volume_type_id=a165d686-abd5-408b-aeb8-6d0a37c148e1)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030d9488-d0ce-4089-acb5-1bc391934f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030d9488-d0ce-4089-acb5-1bc391934f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f429555-0173-44b5-9c31-0dcc0968ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f429555-0173-44b5-9c31-0dcc0968ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0920fdd1-fa38-4db1-9f34-7525c863d1e4', 'volume_name': 'volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9befed63-bbeb-417d-814a-67149b529057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9befed63-bbeb-417d-814a-67149b529057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a17d36-0b35-4334-b56c-9ae4227e54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Volume 0920fdd1-fa38-4db1-9f34-7525c863d1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4', 'volume_size': 1} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:03 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 1073741824" returned: 0 in 0.619s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:04 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 Jul 29 16:07:04 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:04 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792" returned: 0 in 0.285s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99532ffd-79f7-4a33-82ae-86e2b3259f2c,created_at=2026-07-29T14:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646950774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99532ffd-79f7-4a33-82ae-86e2b3259f2c,host='devstack@QuobyteHD#QuobyteHD',id=0920fdd1-fa38-4db1-9f34-7525c863d1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810d23e942ff4312a06bd321495b3e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:04Z,use_quota=True,user_id='be25be91efbc41d4b777a8b79b8a7332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a165d686-abd5-408b-aeb8-6d0a37c148e1),volume_type_id=a165d686-abd5-408b-aeb8-6d0a37c148e1)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Creating volume 0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:04 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0bed53-6e83-4814-8c5b-28ffb9f6d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a325792-39c4-4e74-975b-fa22934a4792', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:04 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 1073741824 Jul 29 16:07:04 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52294804-69bb-4047-92af-0ef5815065a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:04 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Volume volume-7a325792-39c4-4e74-975b-fa22934a4792 (7a325792-39c4-4e74-975b-fa22934a4792): created successfully Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52294804-69bb-4047-92af-0ef5815065a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Flow 'volume_create_manager' (1672b598-6716-4e27-a221-cb26a1bac5f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f03fdf39-737b-4f24-9dd6-6206eb6ad5bd tempest-VolumeQuotasAdminTestJSON-2061075133 None] Created volume successfully. Jul 29 16:07:04 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 1073741824" returned: 0 in 0.524s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:04 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 Jul 29 16:07:04 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:05 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a17d36-0b35-4334-b56c-9ae4227e54d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3b5101-932d-43a4-9b80-0823c580c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Volume volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 (0920fdd1-fa38-4db1-9f34-7525c863d1e4): created successfully Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3b5101-932d-43a4-9b80-0823c580c32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Flow 'volume_create_manager' (be96baf7-5911-476e-895e-c6ffe7399450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d8629200-f713-41f8-8de5-9a766662119e tempest-GroupSnapshotsTest-831054771 None] Created volume successfully. Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "cinder-7a325792-39c4-4e74-975b-fa22934a4792-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "cinder-7a325792-39c4-4e74-975b-fa22934a4792-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Flow 'volume_create_manager' (aa895740-e68d-406f-bfbf-1d874e6740d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec80c3cf-0ba3-4ce4-906f-62cef9c3efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "cinder-quobyte-7a325792-39c4-4e74-975b-fa22934a4792" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec80c3cf-0ba3-4ce4-906f-62cef9c3efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-814691997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36f871c-ca72-4f43-bbe1-1f90d2bbda6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bedecdd97d174dce82ca9c4a379db048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:05Z,use_quota=True,user_id='b2775e86468c455ab1ccccc67bdc6017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb0911e-a08f-4377-9105-b64e3de4f12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb0911e-a08f-4377-9105-b64e3de4f12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0578ff-ff7f-4dff-be10-805f21e5469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0578ff-ff7f-4dff-be10-805f21e5469e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36f871c-ca72-4f43-bbe1-1f90d2bbda6c', 'volume_name': 'volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c6eafa-4cbd-4e2b-b7ac-c45ac1a8a73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c6eafa-4cbd-4e2b-b7ac-c45ac1a8a73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5eb3fd7-2dfc-4e4f-a9eb-12f8036b40f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Volume b36f871c-ca72-4f43-bbe1-1f90d2bbda6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c', 'volume_size': 1} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-814691997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36f871c-ca72-4f43-bbe1-1f90d2bbda6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bedecdd97d174dce82ca9c4a379db048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:05Z,use_quota=True,user_id='b2775e86468c455ab1ccccc67bdc6017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Creating volume b36f871c-ca72-4f43-bbe1-1f90d2bbda6c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:05 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "cinder-quobyte-7a325792-39c4-4e74-975b-fa22934a4792" acquired by "delete_volume" :: waited 0.088s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:05 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c 1073741824 Jul 29 16:07:05 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72bb21c-f7bd-48f3-b112-be4392c91fc5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:05 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 Jul 29 16:07:05 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:06 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c 1073741824" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:06 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:06 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c Jul 29 16:07:06 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:06 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792 Jul 29 16:07:06 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:06 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:06 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5eb3fd7-2dfc-4e4f-a9eb-12f8036b40f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5aa228d-6f34-41c0-bf7a-05c3ca244f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7a325792-39c4-4e74-975b-fa22934a4792" returned: 0 in 0.264s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "cinder-quobyte-7a325792-39c4-4e74-975b-fa22934a4792" released by "delete_volume" :: held 0.746s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:06 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Volume volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c (b36f871c-ca72-4f43-bbe1-1f90d2bbda6c): created successfully Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5aa228d-6f34-41c0-bf7a-05c3ca244f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Flow 'volume_create_manager' (aa895740-e68d-406f-bfbf-1d874e6740d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9a19df4d-7eb5-44f9-aab2-bedf6e757be5 tempest-VolumesTestJSON-93588975 None] Created volume successfully. Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Created reservations ['4ed57f7f-e682-4f99-84a7-06e36f5a9dda', '976fbfab-626b-4ea3-aa49-301cfbf5cbc5', '399f9425-edde-4969-a8e3-cfc2ae5aad90', '41513214-e1ed-4413-ae1e-40091421afc7'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:06 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:06 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] GroupSnapshot 717b113d-fdd0-430f-8b5f-ff07ca532623: creating. Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Group snapshot 717b113d-fdd0-430f-8b5f-ff07ca532623: creating. {{(pid=88575) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Creating offline snapshot 6a7d002f-082e-44be-b5e4-f7491e7333a6 of volume 0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8e1bd-834c-4b59-b8f0-e9acf1cd8dd4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:06 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 Jul 29 16:07:06 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:07 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.477s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Deleted volume successfully. Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6a56f828-ed14-4d03-b378-617cf73aa67f tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "cinder-7a325792-39c4-4e74-975b-fa22934a4792-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:07 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4" returned: 0 in 0.443s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:07 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 1G Jul 29 16:07:07 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Flow 'volume_create_manager' (87895ecd-5b96-49bc-a1d5-63a8cc39bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6d97f1-ebb0-41bd-b776-07c9e84aab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6d97f1-ebb0-41bd-b776-07c9e84aab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533233081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2458fbac-52a1-4f05-aa45-39d6ecb284ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bedecdd97d174dce82ca9c4a379db048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:07Z,use_quota=True,user_id='b2775e86468c455ab1ccccc67bdc6017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fde9516-940a-4628-a3c3-708245d143b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fde9516-940a-4628-a3c3-708245d143b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1ee2ae-ebf8-42a2-b6a5-50677106ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1ee2ae-ebf8-42a2-b6a5-50677106ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2458fbac-52a1-4f05-aa45-39d6ecb284ce', 'volume_name': 'volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d363560f-c873-4e4e-ba78-7f558b159b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d363560f-c873-4e4e-ba78-7f558b159b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32035267-cd8e-4745-8a4e-7448403c241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Volume 2458fbac-52a1-4f05-aa45-39d6ecb284ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce', 'volume_size': 1} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Flow 'volume_create_manager' (07e290ba-b397-4fef-9868-2dc861ec6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aed51a3-943c-49e6-9340-6ce674daf7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aed51a3-943c-49e6-9340-6ce674daf7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1002002589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8395941d-27ca-4209-b099-0386ae1fd3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb005e1713f74862a9fa3df1636724b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:07Z,use_quota=True,user_id='9d17f285a1dd455dbe47b0bebb090537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983f024d-b0a5-4ff5-874c-7ca6b3b605fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983f024d-b0a5-4ff5-874c-7ca6b3b605fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817e6a41-ef1a-498c-a1a7-156c2a0af695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817e6a41-ef1a-498c-a1a7-156c2a0af695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8395941d-27ca-4209-b099-0386ae1fd3a7', 'volume_name': 'volume-8395941d-27ca-4209-b099-0386ae1fd3a7', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cf3eba-05c7-4930-a8a7-0529e35c1fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cf3eba-05c7-4930-a8a7-0529e35c1fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6001097-8937-496c-a2cd-885cbc1585cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Volume 8395941d-27ca-4209-b099-0386ae1fd3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8395941d-27ca-4209-b099-0386ae1fd3a7', 'volume_size': 1} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:07 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 1G" returned: 0 in 0.435s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:07 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 Jul 29 16:07:07 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:07 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:07 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:07:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:07 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 Jul 29 16:07:07 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:08 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:08 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info Jul 29 16:07:08 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:08 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:08 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:08 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info Jul 29 16:07:08 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:08 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.info" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533233081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2458fbac-52a1-4f05-aa45-39d6ecb284ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bedecdd97d174dce82ca9c4a379db048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:07Z,use_quota=True,user_id='b2775e86468c455ab1ccccc67bdc6017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Creating volume 2458fbac-52a1-4f05-aa45-39d6ecb284ce {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:08 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:08 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce 1073741824 Jul 29 16:07:08 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-47731c22-7eff-426a-b606-eeb357064cea tempest-GroupSnapshotsTest-831054771 None] group_snapshot 717b113d-fdd0-430f-8b5f-ff07ca532623: created successfully Jul 29 16:07:09 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce 1073741824" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:09 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce Jul 29 16:07:09 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:09 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1002002589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8395941d-27ca-4209-b099-0386ae1fd3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb005e1713f74862a9fa3df1636724b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:07Z,use_quota=True,user_id='9d17f285a1dd455dbe47b0bebb090537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Creating volume 8395941d-27ca-4209-b099-0386ae1fd3a7 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:09 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32035267-cd8e-4745-8a4e-7448403c241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:09 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 1073741824 Jul 29 16:07:09 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c5405c-a083-4a1e-b1d7-82fd521ec8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:09 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Volume volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce (2458fbac-52a1-4f05-aa45-39d6ecb284ce): created successfully Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c5405c-a083-4a1e-b1d7-82fd521ec8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Flow 'volume_create_manager' (87895ecd-5b96-49bc-a1d5-63a8cc39bc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c692fa99-3099-4cad-ba64-8b50b1e111cb tempest-VolumesTestJSON-93588975 None] Created volume successfully. Jul 29 16:07:09 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] group_snapshot 717b113d-fdd0-430f-8b5f-ff07ca532623: deleting Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 1073741824" returned: 0 in 0.498s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] group_snapshot 717b113d-fdd0-430f-8b5f-ff07ca532623: deleting {{(pid=88575) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-0920fdd1-fa38-4db1-9f34-7525c863d1e4" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:10 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 Jul 29 16:07:10 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-0920fdd1-fa38-4db1-9f34-7525c863d1e4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-6a7d002f-082e-44be-b5e4-f7491e7333a6" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-6a7d002f-082e-44be-b5e4-f7491e7333a6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Deleting offline snapshot 6a7d002f-082e-44be-b5e4-f7491e7333a6 of volume 0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] snapshot_file for this snap is: volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d44cf8b-c2c9-43b3-9a27-68ee24a4c1a5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:10 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 Jul 29 16:07:10 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:10 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7" returned: 0 in 0.287s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6001097-8937-496c-a2cd-885cbc1585cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8395941d-27ca-4209-b099-0386ae1fd3a7', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292116ca-5827-4901-b874-7c4b4d69b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Volume volume-8395941d-27ca-4209-b099-0386ae1fd3a7 (8395941d-27ca-4209-b099-0386ae1fd3a7): created successfully Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292116ca-5827-4901-b874-7c4b4d69b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Flow 'volume_create_manager' (07e290ba-b397-4fef-9868-2dc861ec6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-91c6275a-3739-48d0-a323-c1df6d100dd2 tempest-VolumeQuotasAdminTestJSON-2061075133 None] Created volume successfully. Jul 29 16:07:10 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6" returned: 0 in 0.454s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b575a34-2fde-4f82-b417-f97147e18191]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:10 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 Jul 29 16:07:10 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Flow 'volume_create_manager' (0beae665-3267-4767-b5fd-96f2a1c8a136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f689611-d709-4901-a79a-2e59f9529f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f689611-d709-4901-a79a-2e59f9529f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-34983395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a1ef90-a4da-45d9-86e8-fde4bdd55a40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bedecdd97d174dce82ca9c4a379db048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:11Z,use_quota=True,user_id='b2775e86468c455ab1ccccc67bdc6017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185476c4-c9e7-4be9-908b-9dbe80fe1ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185476c4-c9e7-4be9-908b-9dbe80fe1ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff316c4-3f64-481c-a921-3ce87256372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff316c4-3f64-481c-a921-3ce87256372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a1ef90-a4da-45d9-86e8-fde4bdd55a40', 'volume_name': 'volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd358099-7a8d-4cf6-9818-8d19035e8bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd358099-7a8d-4cf6-9818-8d19035e8bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38770f3e-e5e8-4715-b6d3-0ce938f7c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Volume b5a1ef90-a4da-45d9-86e8-fde4bdd55a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40', 'volume_size': 1} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-34983395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a1ef90-a4da-45d9-86e8-fde4bdd55a40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bedecdd97d174dce82ca9c4a379db048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:11Z,use_quota=True,user_id='b2775e86468c455ab1ccccc67bdc6017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Creating volume b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:11 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:11 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 1073741824 Jul 29 16:07:11 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:11 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4" returned: 0 in 0.422s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:11 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 Jul 29 16:07:11 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-883af533-78cc-45c7-b3b8-a8294b64aded tempest-VolumeQuotasAdminTestJSON-771144827 None] Transfer volume completed successfully. Jul 29 16:07:11 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6" returned: 0 in 0.458s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:11 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6 Jul 29 16:07:11 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:11 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 1073741824" returned: 0 in 0.564s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:11 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 Jul 29 16:07:11 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:11 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4.6a7d002f-082e-44be-b5e4-f7491e7333a6" returned: 0 in 0.314s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-6a7d002f-082e-44be-b5e4-f7491e7333a6" released by "_delete_snapshot" :: held 1.793s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-0920fdd1-fa38-4db1-9f34-7525c863d1e4" released by "delete_snapshot" :: held 1.821s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:11 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40" returned: 0 in 0.281s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38770f3e-e5e8-4715-b6d3-0ce938f7c036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798753fa-295f-4101-b17a-2adfc878eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Acquiring lock "cinder-8395941d-27ca-4209-b099-0386ae1fd3a7-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Volume volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 (b5a1ef90-a4da-45d9-86e8-fde4bdd55a40): created successfully Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798753fa-295f-4101-b17a-2adfc878eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Flow 'volume_create_manager' (0beae665-3267-4767-b5fd-96f2a1c8a136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Lock "cinder-8395941d-27ca-4209-b099-0386ae1fd3a7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:12 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6cccbd10-da12-4c22-8a5c-de156190ce54 tempest-VolumesTestJSON-93588975 None] Created volume successfully. Jul 29 16:07:12 devstack cinder-volume[88575]: WARNING cinder.quota [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-873816925 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-873816925, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:12 devstack cinder-volume[88575]: WARNING cinder.quota [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-873816925 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-873816925, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Acquiring lock "cinder-quobyte-8395941d-27ca-4209-b099-0386ae1fd3a7" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] Created reservations ['cde59c41-0dab-47a3-8f8f-e435f58f8b19', '301f3a7d-e28a-43a5-a83b-08447045ae52', '85919135-a362-40b6-9f5e-44f58d06bda9', '5f720eff-71fc-40e7-b410-aae36e88a0cb'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Lock "cinder-quobyte-8395941d-27ca-4209-b099-0386ae1fd3a7" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ab58d3-ab5d-4478-8845-acba09abdb44]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:12 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8b85fb25-7787-4d44-83ad-e372f3e7ac3c tempest-GroupSnapshotsTest-831054771 None] group_snapshot 717b113d-fdd0-430f-8b5f-ff07ca532623: deleted successfully Jul 29 16:07:12 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 Jul 29 16:07:12 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:12 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7" returned: 0 in 0.444s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:12 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7 Jul 29 16:07:12 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "cinder-quobyte-0920fdd1-fa38-4db1-9f34-7525c863d1e4" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-0920fdd1-fa38-4db1-9f34-7525c863d1e4" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf7b293-b5cd-483d-9873-1736891ab554]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:12 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 Jul 29 16:07:12 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:12 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8395941d-27ca-4209-b099-0386ae1fd3a7" returned: 0 in 0.346s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Lock "cinder-quobyte-8395941d-27ca-4209-b099-0386ae1fd3a7" released by "delete_volume" :: held 0.849s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Created reservations ['ec0be4e7-c06f-4d14-8faf-717eb1678326', '02b08159-9f3b-435a-bd8d-6c2c9488c259', '03c98dfe-173a-4760-bd64-27cd72692bd2', '6e2977d9-22c1-40f0-8e5d-040dc5b38c30'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:13 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:13 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:13 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4" returned: 0 in 0.468s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:13 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4 Jul 29 16:07:13 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:13 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.328s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:13 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Deleted volume successfully. Jul 29 16:07:13 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0920fdd1-fa38-4db1-9f34-7525c863d1e4" returned: 0 in 0.279s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Lock "cinder-quobyte-0920fdd1-fa38-4db1-9f34-7525c863d1e4" released by "delete_volume" :: held 0.851s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf6f8e43-c490-491c-b96c-e6821b6591e6 tempest-VolumeQuotasAdminTestJSON-1070405011 None] Lock "cinder-8395941d-27ca-4209-b099-0386ae1fd3a7-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Created reservations ['d46ce8ff-a848-4e68-b1ab-72dcc53d5438'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:13 devstack cinder-volume[88575]: WARNING cinder.quota [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-873816925 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-873816925, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Created reservations ['ff41ba96-4185-46d3-bf3c-2d99fd86c79a', '276af021-4afe-4347-8738-112355fdfc4a', 'b3ed7248-bdf2-4954-be90-16d30cac6b7a', '0ef2ee6b-331c-487e-9e1a-7385ee5ea66e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:13 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:13 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Acquiring lock "cinder-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:14 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-63520323-e82d-4399-be6f-4df25091ce21 tempest-GroupSnapshotsTest-831054771 None] Delete group completed successfully. Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Lock "cinder-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Acquiring lock "cinder-quobyte-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Lock "cinder-quobyte-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1714269-476b-4d6d-92da-e9441ae4ce26]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:14 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 Jul 29 16:07:14 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:14 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:14 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40 Jul 29 16:07:14 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:15 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40" returned: 0 in 0.292s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Lock "cinder-quobyte-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40" released by "delete_volume" :: held 0.799s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Created reservations ['f5766c96-bf44-4dfe-8b74-b9f5503eb93d', '6fb0d51c-cfcb-4e7a-a934-4260920aa15d', 'b53cb22d-bcce-442d-86ea-285e7b50105f', '29f137f2-0a49-4bec-80da-1a81e70344db'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:15 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:15 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Acquiring lock "cinder-2458fbac-52a1-4f05-aa45-39d6ecb284ce-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Lock "cinder-2458fbac-52a1-4f05-aa45-39d6ecb284ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Acquiring lock "cinder-quobyte-2458fbac-52a1-4f05-aa45-39d6ecb284ce" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Lock "cinder-quobyte-2458fbac-52a1-4f05-aa45-39d6ecb284ce" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:15 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.325s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Deleted volume successfully. Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304d969-805b-4e3f-ae79-5f76cd882382]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4845c386-0132-48f8-8fb1-3cb1629a0691 tempest-VolumesTestJSON-93588975 None] Lock "cinder-b5a1ef90-a4da-45d9-86e8-fde4bdd55a40-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:15 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce Jul 29 16:07:15 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:16 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce" returned: 0 in 0.494s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:16 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce Jul 29 16:07:16 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:16 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2458fbac-52a1-4f05-aa45-39d6ecb284ce" returned: 0 in 0.334s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Lock "cinder-quobyte-2458fbac-52a1-4f05-aa45-39d6ecb284ce" released by "delete_volume" :: held 0.902s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Created reservations ['2da9ea73-a36e-4870-908b-c948a891f1cd', '082a65c8-b106-4498-a7bc-34d02d66faa1', '6f7d8fd5-0112-41d6-a07b-18c76ede6a25', '80049568-4b6b-4ce5-bd51-022254061a3e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:16 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:16 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:16 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.284s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:16 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Deleted volume successfully. Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1dfa495e-cfa0-47f8-81d0-3a8d6b3bfcf2 tempest-VolumesTestJSON-93588975 None] Lock "cinder-2458fbac-52a1-4f05-aa45-39d6ecb284ce-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Acquiring lock "cinder-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Lock "cinder-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Acquiring lock "cinder-quobyte-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Lock "cinder-quobyte-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c" acquired by "delete_volume" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ab74b-5563-4ed1-b43f-cbb2f94ebb59]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:18 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c Jul 29 16:07:18 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:18 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c" returned: 0 in 0.463s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:18 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c Jul 29 16:07:18 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:18 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Lock "cinder-quobyte-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c" released by "delete_volume" :: held 0.812s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Created reservations ['08d0bb85-ba0f-4204-9a1a-1a99e64d7c66', '978fdff1-444a-4d34-a7ba-0df13ca723a3', 'c8299e54-a905-42d5-972b-40d6f4f32496', '0813bf36-d826-4764-b73e-a5979c254130'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:18 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:18 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:19 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.352s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:19 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Deleted volume successfully. Jul 29 16:07:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-92c3ecdc-5466-4337-ac7f-d26628831f12 tempest-VolumesTestJSON-93588975 None] Lock "cinder-b36f871c-ca72-4f43-bbe1-1f90d2bbda6c-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Flow 'volume_create_manager' (a0fd2e82-44af-4286-80b0-ff59d72c9f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83346fe-0d1d-4844-86db-4da4057b347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83346fe-0d1d-4844-86db-4da4057b347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1529375481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17818e2d-e470-478a-8680-efe54624cdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c93c5a52af44ef0a6d9ccc202f5b968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:24Z,use_quota=True,user_id='c6426c24241d449bb1b1deea1df72043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ade818d-6a7f-4b85-bc49-4350ddb3ce73),volume_type_id=2ade818d-6a7f-4b85-bc49-4350ddb3ce73)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac08310e-6f96-44c5-9d48-20e0a3185e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac08310e-6f96-44c5-9d48-20e0a3185e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22428d26-f5ae-4374-b7a4-6cae825234c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22428d26-f5ae-4374-b7a4-6cae825234c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17818e2d-e470-478a-8680-efe54624cdc6', 'volume_name': 'volume-17818e2d-e470-478a-8680-efe54624cdc6', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c582e7-c9cd-43f2-935e-9436d9d97217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c582e7-c9cd-43f2-935e-9436d9d97217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf8f6d9-b583-4800-bb93-dd71049a9271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:23 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Volume 17818e2d-e470-478a-8680-efe54624cdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17818e2d-e470-478a-8680-efe54624cdc6', 'volume_size': 1} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1529375481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17818e2d-e470-478a-8680-efe54624cdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c93c5a52af44ef0a6d9ccc202f5b968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:24Z,use_quota=True,user_id='c6426c24241d449bb1b1deea1df72043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ade818d-6a7f-4b85-bc49-4350ddb3ce73),volume_type_id=2ade818d-6a7f-4b85-bc49-4350ddb3ce73)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Creating volume 17818e2d-e470-478a-8680-efe54624cdc6 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:23 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:23 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 1073741824 Jul 29 16:07:23 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:24 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 1073741824" returned: 0 in 0.591s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:24 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 Jul 29 16:07:24 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:24 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6" returned: 0 in 0.421s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf8f6d9-b583-4800-bb93-dd71049a9271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17818e2d-e470-478a-8680-efe54624cdc6', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf2ced2-47ae-4ba3-8488-ed7e971a7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:25 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Volume volume-17818e2d-e470-478a-8680-efe54624cdc6 (17818e2d-e470-478a-8680-efe54624cdc6): created successfully Jul 29 16:07:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf2ced2-47ae-4ba3-8488-ed7e971a7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Flow 'volume_create_manager' (a0fd2e82-44af-4286-80b0-ff59d72c9f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-68fdcd51-0bd3-40af-971d-5e70a50a9b21 tempest-GroupSnapshotsV319Test-285172766 None] Group tempest-GroupSnapshotsV319Test-Group-397728502: creating Jul 29 16:07:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-878c92e8-5267-4ea1-9ffb-4643e6fc55d5 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Created volume successfully. Jul 29 16:07:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-68fdcd51-0bd3-40af-971d-5e70a50a9b21 tempest-GroupSnapshotsV319Test-285172766 None] Group tempest-GroupSnapshotsV319Test-Group-397728502: created successfully Jul 29 16:07:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-68fdcd51-0bd3-40af-971d-5e70a50a9b21 tempest-GroupSnapshotsV319Test-285172766 None] Create group completed successfully. Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:26 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:26 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Flow 'volume_create_manager' (aaaadaad-b00f-4689-9380-7e7f388c02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d65532-1649-4e8a-8f51-74219f7dbcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d65532-1649-4e8a-8f51-74219f7dbcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750134493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f90f7068-b55f-4bff-ad42-6cf00b8e343e,host='devstack@QuobyteHD#QuobyteHD',id=c7a422ea-8fff-4408-b354-94242bba487e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810cceed7f3b470a90dd6680f6dd6076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:27Z,use_quota=True,user_id='be99fcdf27254a47a1fdeaaa6ab28613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9bc5954-0816-4c25-982a-ad176a99ab04),volume_type_id=b9bc5954-0816-4c25-982a-ad176a99ab04)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd6f349-9f1f-492a-a087-d0d38b8dff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd6f349-9f1f-492a-a087-d0d38b8dff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:26 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62157e2-e95b-41a1-8139-45b1120a0a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62157e2-e95b-41a1-8139-45b1120a0a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a422ea-8fff-4408-b354-94242bba487e', 'volume_name': 'volume-c7a422ea-8fff-4408-b354-94242bba487e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762f61e4-b8c5-4026-b9f9-a941ea1df8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762f61e4-b8c5-4026-b9f9-a941ea1df8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227f4676-ac07-4c76-b12e-06cbe8823864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Volume c7a422ea-8fff-4408-b354-94242bba487e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a422ea-8fff-4408-b354-94242bba487e', 'volume_size': 1} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f90f7068-b55f-4bff-ad42-6cf00b8e343e,created_at=2026-07-29T14:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750134493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f90f7068-b55f-4bff-ad42-6cf00b8e343e,host='devstack@QuobyteHD#QuobyteHD',id=c7a422ea-8fff-4408-b354-94242bba487e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810cceed7f3b470a90dd6680f6dd6076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:27Z,use_quota=True,user_id='be99fcdf27254a47a1fdeaaa6ab28613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9bc5954-0816-4c25-982a-ad176a99ab04),volume_type_id=b9bc5954-0816-4c25-982a-ad176a99ab04)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Creating volume c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:27 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.504s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:27 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e111011b-1eb4-4b9c-b95c-2342256c0fd9 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Retype volume completed successfully. Jul 29 16:07:27 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e 1073741824 Jul 29 16:07:27 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:27 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e 1073741824" returned: 0 in 0.588s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:27 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e Jul 29 16:07:27 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Acquiring lock "cinder-17818e2d-e470-478a-8680-efe54624cdc6-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "cinder-17818e2d-e470-478a-8680-efe54624cdc6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Acquiring lock "cinder-quobyte-17818e2d-e470-478a-8680-efe54624cdc6" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "cinder-quobyte-17818e2d-e470-478a-8680-efe54624cdc6" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef95c1-248e-4e44-9606-ffebd05231d9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:28 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227f4676-ac07-4c76-b12e-06cbe8823864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a422ea-8fff-4408-b354-94242bba487e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b816eb68-cf13-4b42-a743-57b0cab15ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:28 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Volume volume-c7a422ea-8fff-4408-b354-94242bba487e (c7a422ea-8fff-4408-b354-94242bba487e): created successfully Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b816eb68-cf13-4b42-a743-57b0cab15ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Flow 'volume_create_manager' (aaaadaad-b00f-4689-9380-7e7f388c02a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a8aaceca-163b-4fbb-84e1-f9c8f1e0364f tempest-GroupSnapshotsV319Test-285172766 None] Created volume successfully. Jul 29 16:07:28 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 Jul 29 16:07:28 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:28 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6" returned: 0 in 0.499s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:28 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6 Jul 29 16:07:28 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:28 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-17818e2d-e470-478a-8680-efe54624cdc6" returned: 0 in 0.397s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "cinder-quobyte-17818e2d-e470-478a-8680-efe54624cdc6" released by "delete_volume" :: held 0.969s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:28 devstack cinder-volume[88575]: WARNING cinder.quota [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:28 devstack cinder-volume[88575]: WARNING cinder.quota [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:28 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Created reservations ['5b27a3a9-4fe9-404d-8f31-b42dc2db2b8d', 'f86857f1-c39f-414b-985f-fd0210a3aa34', '9ecd2573-9f49-4bde-a69f-cb50d3429807', 'c1d53674-e854-4b10-8fa2-2603117ed065'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:29 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:29 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:29 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Deleted volume successfully. Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e641e547-1556-4dee-8e57-e2437bf7c947 tempest-VolumeRetypeWithoutMigrationTest-814013974 None] Lock "cinder-17818e2d-e470-478a-8680-efe54624cdc6-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] GroupSnapshot 28797bea-e8c5-4e21-9177-5878266a301e: creating. Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Group snapshot 28797bea-e8c5-4e21-9177-5878266a301e: creating. {{(pid=88575) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Creating offline snapshot dccc604a-07df-40c6-914c-dcc90e64e453 of volume c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c57d8c2-0688-47ec-97a3-53bd42274b78]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:29 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e Jul 29 16:07:29 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:30 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e" returned: 0 in 0.402s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:30 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 1G Jul 29 16:07:30 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:30 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 1G" returned: 0 in 0.495s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7a422ea-8fff-4408-b354-94242bba487e -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:30 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7a422ea-8fff-4408-b354-94242bba487e -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 Jul 29 16:07:30 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:31 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7a422ea-8fff-4408-b354-94242bba487e -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453" returned: 0 in 0.358s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:31 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:31 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 Jul 29 16:07:31 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:31 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453" returned: 0 in 0.250s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:31 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info Jul 29 16:07:31 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:31 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:31 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:31 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info Jul 29 16:07:31 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:31 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.info" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:32 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-935cc559-b37c-477c-89b5-a4934ce22ff0 tempest-GroupSnapshotsV319Test-285172766 None] group_snapshot 28797bea-e8c5-4e21-9177-5878266a301e: created successfully Jul 29 16:07:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] group_snapshot 28797bea-e8c5-4e21-9177-5878266a301e: deleting Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] group_snapshot 28797bea-e8c5-4e21-9177-5878266a301e: deleting {{(pid=88575) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "cinder-quobyte-c7a422ea-8fff-4408-b354-94242bba487e" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Lock "cinder-quobyte-c7a422ea-8fff-4408-b354-94242bba487e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "cinder-quobyte-dccc604a-07df-40c6-914c-dcc90e64e453" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Lock "cinder-quobyte-dccc604a-07df-40c6-914c-dcc90e64e453" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Deleting offline snapshot dccc604a-07df-40c6-914c-dcc90e64e453 of volume c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] snapshot_file for this snap is: volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905a2d1-3e59-4dcc-b717-e584dbe1e01f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:33 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 Jul 29 16:07:33 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:34 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453" returned: 0 in 0.482s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7a422ea-8fff-4408-b354-94242bba487e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6228d1-437a-4979-844a-92cf019b0ba0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:34 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e Jul 29 16:07:34 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:34 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e" returned: 0 in 0.397s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:34 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 Jul 29 16:07:34 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:34 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:34 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453 Jul 29 16:07:34 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:35 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e.dccc604a-07df-40c6-914c-dcc90e64e453" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Lock "cinder-quobyte-dccc604a-07df-40c6-914c-dcc90e64e453" released by "_delete_snapshot" :: held 1.804s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Lock "cinder-quobyte-c7a422ea-8fff-4408-b354-94242bba487e" released by "delete_snapshot" :: held 1.834s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:35 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=185,cinder:SELECT=191,cinder:INSERT=36,cinder:DELETE=8 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:07:35 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=169,cinder:INSERT=47,cinder:UPDATE=191,cinder:DELETE=12 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:07:35 devstack cinder-volume[88575]: WARNING cinder.quota [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-420728683 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-420728683, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:35 devstack cinder-volume[88575]: WARNING cinder.quota [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-420728683 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-420728683, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:35 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] Created reservations ['c85a3415-7086-427f-b74d-4a4e8eb882ec', '4c1b2d03-dd15-4d26-ace5-b5edf4e0d2f5', '8c4c2db0-2e70-4653-8a74-223f09263766', '077bcf0b-0412-4450-bd41-d6d2c6ee9732'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6e3ba9aa-ac9c-4b28-a5ed-b6b9e1747a62 tempest-GroupSnapshotsV319Test-285172766 None] group_snapshot 28797bea-e8c5-4e21-9177-5878266a301e: deleted successfully Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "cinder-quobyte-c7a422ea-8fff-4408-b354-94242bba487e" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Lock "cinder-quobyte-c7a422ea-8fff-4408-b354-94242bba487e" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc26998-02e5-4e2b-8dc4-be822450263a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:36 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e Jul 29 16:07:36 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:36 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e" returned: 0 in 0.471s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:36 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:36 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:36 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e Jul 29 16:07:36 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:37 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:37 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c7a422ea-8fff-4408-b354-94242bba487e" returned: 0 in 0.304s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.358s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Lock "cinder-quobyte-c7a422ea-8fff-4408-b354-94242bba487e" released by "delete_volume" :: held 0.875s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Created reservations ['061b7b77-1f21-483f-b920-d2d90e2fb8cf'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:37 devstack cinder-volume[88575]: WARNING cinder.quota [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-420728683 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-420728683, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Created reservations ['4fc7ddf5-f152-45f5-8f2b-3e07ea5facc8', 'c55bab01-b9f6-4316-958a-3cce735d3551', '7a935d75-2328-40d7-a9de-608adec4dfa8', 'f20c8e16-b07e-452c-83f8-c425fea750ca'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:37 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:37 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:37 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.296s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0ac18243-68c2-44de-a12a-027d59e09250 tempest-GroupSnapshotsV319Test-285172766 None] Delete group completed successfully. Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Flow 'volume_create_manager' (93445737-5755-429e-b2ac-2da28fd5e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c023708-422e-4aa0-84ba-a295c66ae6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c023708-422e-4aa0-84ba-a295c66ae6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-228173304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e7f296-0c91-474c-841e-9b44b4673926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73474a17dfba42e986ada80de5f2f4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:41Z,use_quota=True,user_id='80cddecdb9354049add0b06f0468b2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0900496-42dc-4a61-99ef-affe8fa8d0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0900496-42dc-4a61-99ef-affe8fa8d0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4ad040-fb48-490d-9298-48bae5eadc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:40 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:07:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4ad040-fb48-490d-9298-48bae5eadc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8e7f296-0c91-474c-841e-9b44b4673926', 'volume_name': 'volume-c8e7f296-0c91-474c-841e-9b44b4673926', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c651401-b47a-4130-85fb-2b0219fdfb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c651401-b47a-4130-85fb-2b0219fdfb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d65c21-8e10-418a-b849-9784e1b02a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Volume c8e7f296-0c91-474c-841e-9b44b4673926: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8e7f296-0c91-474c-841e-9b44b4673926', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 29 16:07:41 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Trying to clone c8e7f296-0c91-474c-841e-9b44b4673926 from image 16778ff0-340b-4c4a-846b-47774617fa95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:07:41 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:07:41 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Image download 20.69 MB at 20.69 MB/s Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9605999-94e6-47c6-a16d-7424ca8d52c9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:42 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD Jul 29 16:07:42 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:42 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 is fetched for user 80cddecdb9354049add0b06f0468b2b2. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7c3052-1732-49a0-a776-8de366a95431]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:42 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD Jul 29 16:07:42 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:42 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-228173304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e7f296-0c91-474c-841e-9b44b4673926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73474a17dfba42e986ada80de5f2f4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:41Z,use_quota=True,user_id='80cddecdb9354049add0b06f0468b2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Creating volume c8e7f296-0c91-474c-841e-9b44b4673926 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:42 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:42 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 1073741824 Jul 29 16:07:42 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:43 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 1073741824" returned: 0 in 0.541s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:43 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 Jul 29 16:07:43 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:43 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926" returned: 0 in 0.339s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Attempting download of 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume c8e7f296-0c91-474c-841e-9b44b4673926. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf5417-77d6-4478-a6ff-cca5d3e9599f]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:44 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6 Jul 29 16:07:44 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:44 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6" returned: 0 in 0.395s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:44 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6 Jul 29 16:07:44 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:44 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6" returned: 1 in 0.405s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_n19ry3s6' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:07:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabb0dcc-bdb9-45b3-91ec-22214cdd08dc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:44 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD Jul 29 16:07:44 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:45 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:45 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] 16778ff0-340b-4c4a-846b-47774617fa95 was qcow2, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:07:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:45 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 Jul 29 16:07:45 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:47 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926" returned: 0 in 2.294s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_9_6ohugwdevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:07:47 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Converted 112.00 MB image at 48.79 MB/s Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:47 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 1G Jul 29 16:07:47 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:47 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 1G" returned: 0 in 0.440s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Downloaded image 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume c8e7f296-0c91-474c-841e-9b44b4673926 successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 for user 80cddecdb9354049add0b06f0468b2b2 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Marking volume c8e7f296-0c91-474c-841e-9b44b4673926 as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Copying metadata from image 16778ff0-340b-4c4a-846b-47774617fa95 to c8e7f296-0c91-474c-841e-9b44b4673926. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:07:47 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Creating volume glance metadata for volume c8e7f296-0c91-474c-841e-9b44b4673926 backed by image 16778ff0-340b-4c4a-846b-47774617fa95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d65c21-8e10-418a-b849-9784e1b02a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e7f296-0c91-474c-841e-9b44b4673926', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2188eb08-e254-4989-a1be-403e8b6203d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:48 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Volume volume-c8e7f296-0c91-474c-841e-9b44b4673926 (c8e7f296-0c91-474c-841e-9b44b4673926): created successfully Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2188eb08-e254-4989-a1be-403e8b6203d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Flow 'volume_create_manager' (93445737-5755-429e-b2ac-2da28fd5e53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c19d676f-53e5-45a9-bd49-abc5e26249a5 tempest-VolumesImageMetadata-145428458 None] Created volume successfully. Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Acquiring lock "cinder-c8e7f296-0c91-474c-841e-9b44b4673926-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Lock "cinder-c8e7f296-0c91-474c-841e-9b44b4673926-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Acquiring lock "cinder-quobyte-c8e7f296-0c91-474c-841e-9b44b4673926" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Lock "cinder-quobyte-c8e7f296-0c91-474c-841e-9b44b4673926" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cd2f5d-53c0-4e5e-a72a-1611263e0574]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:49 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 Jul 29 16:07:49 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:49 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926" returned: 0 in 0.444s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:49 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926 Jul 29 16:07:49 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:49 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c8e7f296-0c91-474c-841e-9b44b4673926" returned: 0 in 0.287s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Lock "cinder-quobyte-c8e7f296-0c91-474c-841e-9b44b4673926" released by "delete_volume" :: held 0.794s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Created reservations ['e55a2c0b-e888-4e8e-a696-97d9f2d4a19d', '10da9052-4d60-4752-8a4c-ddaa45c4cada', '89c6d398-caa3-4e4c-84cf-6a93bc3435ed', '15c1c86d-f03f-451a-9cdd-d720092354a8'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:49 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:49 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:50 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.304s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Deleted volume successfully. Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e77c589b-c99e-46e4-a7eb-3e69a3cea012 tempest-VolumesImageMetadata-145428458 None] Lock "cinder-c8e7f296-0c91-474c-841e-9b44b4673926-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Flow 'volume_create_manager' (7ecc878e-f865-4838-8b98-37f83781c10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cdad9d-f27e-409c-9fc2-00893474c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cdad9d-f27e-409c-9fc2-00893474c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1361599924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb83869-885a-4156-b4f7-58fb5f265bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3ab4246d647c2a98f452adf5babf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:51Z,use_quota=True,user_id='42729babeea44bd29a4d30894090af8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd170db6-535d-4f32-baa6-a2aa2dcc6079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd170db6-535d-4f32-baa6-a2aa2dcc6079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849d22db-b606-4c86-abda-0b8bacd4bea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849d22db-b606-4c86-abda-0b8bacd4bea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb83869-885a-4156-b4f7-58fb5f265bba', 'volume_name': 'volume-adb83869-885a-4156-b4f7-58fb5f265bba', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb76685-209e-4d32-9f18-9a9ca63f0a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb76685-209e-4d32-9f18-9a9ca63f0a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92870e9-20be-4175-9792-07d869a3e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Volume adb83869-885a-4156-b4f7-58fb5f265bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb83869-885a-4156-b4f7-58fb5f265bba', 'volume_size': 1} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1361599924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb83869-885a-4156-b4f7-58fb5f265bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3ab4246d647c2a98f452adf5babf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:51Z,use_quota=True,user_id='42729babeea44bd29a4d30894090af8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Creating volume adb83869-885a-4156-b4f7-58fb5f265bba {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:50 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:50 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba 1073741824 Jul 29 16:07:50 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:51 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba 1073741824" returned: 0 in 0.606s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:51 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba Jul 29 16:07:51 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:51 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba" returned: 0 in 0.350s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92870e9-20be-4175-9792-07d869a3e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb83869-885a-4156-b4f7-58fb5f265bba', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0fd6ad-e8fb-4c7a-a64a-19d1d07845ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:51 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Volume volume-adb83869-885a-4156-b4f7-58fb5f265bba (adb83869-885a-4156-b4f7-58fb5f265bba): created successfully Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0fd6ad-e8fb-4c7a-a64a-19d1d07845ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Flow 'volume_create_manager' (7ecc878e-f865-4838-8b98-37f83781c10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-032975a5-bb4d-4501-861c-02be8cfbaef4 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Created volume successfully. Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Acquiring lock "cinder-adb83869-885a-4156-b4f7-58fb5f265bba-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "cinder-adb83869-885a-4156-b4f7-58fb5f265bba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Acquiring lock "cinder-quobyte-adb83869-885a-4156-b4f7-58fb5f265bba" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "cinder-quobyte-adb83869-885a-4156-b4f7-58fb5f265bba" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab582f4-8c35-45e8-91f5-a9bc8730e95b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:54 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba Jul 29 16:07:54 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:54 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba" returned: 0 in 0.486s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:54 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba Jul 29 16:07:54 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:55 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-adb83869-885a-4156-b4f7-58fb5f265bba" returned: 0 in 0.337s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "cinder-quobyte-adb83869-885a-4156-b4f7-58fb5f265bba" released by "delete_volume" :: held 0.886s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Created reservations ['638ba3c2-1d94-428e-ad22-7d5704a11bd2', '89fa5f2b-c82a-4d77-8495-09375cb833c7', '4ac4a974-0445-4f4e-bcf0-356ae71e1527', 'a92e6cc8-c581-4699-af67-d4d7d2fd2242'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:55 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:07:55 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:55 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:07:55 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Deleted volume successfully. Jul 29 16:07:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fd1b1992-a661-41ea-a444-fa1afdcaa0e1 tempest-VolumeQuotasNegativeTestJSON-1535974745 None] Lock "cinder-adb83869-885a-4156-b4f7-58fb5f265bba-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Flow 'volume_create_manager' (2a7cf0ac-a819-4cd8-96c1-8ab9c58c892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c9a0d3-758a-488e-9b5e-386a92552bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c9a0d3-758a-488e-9b5e-386a92552bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-522054291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6f3001-d669-45df-b573-aaa26d1095be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ae23c66f414f7484b84209fef19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:59Z,use_quota=True,user_id='5c002584bc124101a862596a0a399bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15909f7b-8153-45a1-9608-dd74bcc2589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15909f7b-8153-45a1-9608-dd74bcc2589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43204df0-3688-4ad2-9014-c26bfbb9e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43204df0-3688-4ad2-9014-c26bfbb9e419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6f3001-d669-45df-b573-aaa26d1095be', 'volume_name': 'volume-dd6f3001-d669-45df-b573-aaa26d1095be', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29a58e1-897d-4d6f-a2a7-8bc092aef6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29a58e1-897d-4d6f-a2a7-8bc092aef6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe07d57-cc65-4ba2-a455-e0b3998cb44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:07:59 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Volume dd6f3001-d669-45df-b573-aaa26d1095be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6f3001-d669-45df-b573-aaa26d1095be', 'volume_size': 1} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-522054291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6f3001-d669-45df-b573-aaa26d1095be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ae23c66f414f7484b84209fef19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:07:59Z,use_quota=True,user_id='5c002584bc124101a862596a0a399bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Creating volume dd6f3001-d669-45df-b573-aaa26d1095be {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:07:59 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:59 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be 1073741824 Jul 29 16:07:59 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:07:59 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be 1073741824" returned: 0 in 0.596s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:07:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:07:59 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be Jul 29 16:07:59 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:00 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be" returned: 0 in 0.322s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe07d57-cc65-4ba2-a455-e0b3998cb44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6f3001-d669-45df-b573-aaa26d1095be', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aeffd1-1553-4632-bbff-281dca5df31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:00 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Volume volume-dd6f3001-d669-45df-b573-aaa26d1095be (dd6f3001-d669-45df-b573-aaa26d1095be): created successfully Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aeffd1-1553-4632-bbff-281dca5df31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Flow 'volume_create_manager' (2a7cf0ac-a819-4cd8-96c1-8ab9c58c892d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a2485ba5-ca65-4d40-b768-0fd3e927c0e0 tempest-VolumesTransfersTest-1720419030 None] Created volume successfully. Jul 29 16:08:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-23685f38-ad0c-4bee-8e6d-3e4ad5895f88 tempest-VolumesTransfersTest-1723446094 None] Transfer volume completed successfully. Jul 29 16:08:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Acquiring lock "cinder-dd6f3001-d669-45df-b573-aaa26d1095be-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-dd6f3001-d669-45df-b573-aaa26d1095be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Acquiring lock "cinder-quobyte-dd6f3001-d669-45df-b573-aaa26d1095be" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-quobyte-dd6f3001-d669-45df-b573-aaa26d1095be" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da498a9-3e9d-4597-bb0c-1f85264ca89a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:03 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be Jul 29 16:08:03 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Flow 'volume_create_manager' (f145aa12-8309-468d-99aa-28cca729795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f5324f-0f0b-4442-9bf3-c35f6a6264bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f5324f-0f0b-4442-9bf3-c35f6a6264bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1746786403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e586cc-8dc9-4406-a26a-127df5f13060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d99fe7ab7b462b9eff023272467a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:03Z,use_quota=True,user_id='7bf2f6dbf7c84ea385ae41e24641aa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50d94ba-001f-44ce-8941-b47390298239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50d94ba-001f-44ce-8941-b47390298239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e5596a-b2cd-47e4-82b3-a22a8ee3106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e5596a-b2cd-47e4-82b3-a22a8ee3106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e586cc-8dc9-4406-a26a-127df5f13060', 'volume_name': 'volume-f5e586cc-8dc9-4406-a26a-127df5f13060', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32ad001-0ae2-4749-a230-c997d00e102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:03 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32ad001-0ae2-4749-a230-c997d00e102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e32fdb-27b4-4cef-bd1d-4d23cae2e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Volume f5e586cc-8dc9-4406-a26a-127df5f13060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e586cc-8dc9-4406-a26a-127df5f13060', 'volume_size': 1} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1746786403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e586cc-8dc9-4406-a26a-127df5f13060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d99fe7ab7b462b9eff023272467a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:03Z,use_quota=True,user_id='7bf2f6dbf7c84ea385ae41e24641aa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Creating volume f5e586cc-8dc9-4406-a26a-127df5f13060 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:03 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be" returned: 0 in 0.503s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:03 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 1073741824 Jul 29 16:08:03 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:03 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be Jul 29 16:08:03 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:03 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dd6f3001-d669-45df-b573-aaa26d1095be" returned: 0 in 0.290s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-quobyte-dd6f3001-d669-45df-b573-aaa26d1095be" released by "delete_volume" :: held 0.857s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Created reservations ['ddde9a8a-951d-4fd2-9dd6-6bc6d74d3615', 'a890deac-2419-45cb-98e3-4cb7fea5c7d7', '6d0c3b9d-9963-45e9-963c-dac9c3d364c6', 'b7f4098e-f261-4940-bfb0-ea28f4db1e63'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:04 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:04 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:04 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 1073741824" returned: 0 in 0.611s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:04 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 Jul 29 16:08:04 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:04 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.335s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Deleted volume successfully. Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec15b907-cbdf-4fcd-91d5-5a4d0085110c tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-dd6f3001-d669-45df-b573-aaa26d1095be-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:04 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e32fdb-27b4-4cef-bd1d-4d23cae2e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e586cc-8dc9-4406-a26a-127df5f13060', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e05c68b-955c-435a-b44b-3dbda35b7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:04 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Volume volume-f5e586cc-8dc9-4406-a26a-127df5f13060 (f5e586cc-8dc9-4406-a26a-127df5f13060): created successfully Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e05c68b-955c-435a-b44b-3dbda35b7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Flow 'volume_create_manager' (f145aa12-8309-468d-99aa-28cca729795b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-79f41d65-f1f4-497e-8e08-a45723806a06 tempest-VolumesServicesTestJSON-1825019568 None] Created volume successfully. Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Flow 'volume_create_manager' (6b799b04-5f82-4c06-9f6f-6fee70cc2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82c5578-02be-4014-99d1-7b3650ea56d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82c5578-02be-4014-99d1-7b3650ea56d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1178335841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ae23c66f414f7484b84209fef19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:05Z,use_quota=True,user_id='5c002584bc124101a862596a0a399bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba8248a-656a-49c1-bd64-a282994776d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba8248a-656a-49c1-bd64-a282994776d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed71484-118e-41f4-a3e4-e75c012b4f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed71484-118e-41f4-a3e4-e75c012b4f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9', 'volume_name': 'volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c797f5-9090-46fd-9f72-9b46ac99aadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c797f5-9090-46fd-9f72-9b46ac99aadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bad4f6-2153-417d-a311-bc57e79e5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:04 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Volume f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9', 'volume_size': 1} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1178335841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ae23c66f414f7484b84209fef19e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:05Z,use_quota=True,user_id='5c002584bc124101a862596a0a399bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Creating volume f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:04 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:05 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 1073741824 Jul 29 16:08:05 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:05 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 1073741824" returned: 0 in 0.457s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:05 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 Jul 29 16:08:05 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:05 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9" returned: 0 in 0.291s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bad4f6-2153-417d-a311-bc57e79e5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89db5e16-78c8-4074-9faf-048a23cb7105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Acquiring lock "cinder-f5e586cc-8dc9-4406-a26a-127df5f13060-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Volume volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 (f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9): created successfully Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89db5e16-78c8-4074-9faf-048a23cb7105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Flow 'volume_create_manager' (6b799b04-5f82-4c06-9f6f-6fee70cc2194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Lock "cinder-f5e586cc-8dc9-4406-a26a-127df5f13060-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5f22213b-202b-4bf4-aa60-1c4b032f7306 tempest-VolumesTransfersTest-1720419030 None] Created volume successfully. Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Acquiring lock "cinder-quobyte-f5e586cc-8dc9-4406-a26a-127df5f13060" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Lock "cinder-quobyte-f5e586cc-8dc9-4406-a26a-127df5f13060" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a0010-cb7d-436c-9531-83021ed6ff83]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:06 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 Jul 29 16:08:06 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:06 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:06 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060 Jul 29 16:08:06 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:06 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f5e586cc-8dc9-4406-a26a-127df5f13060" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Lock "cinder-quobyte-f5e586cc-8dc9-4406-a26a-127df5f13060" released by "delete_volume" :: held 0.688s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Created reservations ['b82d25dd-8ebc-4c70-a425-efb4307e9950', '211833de-66d6-4eaa-85c2-589406d9fdb6', '9c09b7f2-e939-45a4-b161-4e14113e9e1e', '1960a280-109e-4a14-ae97-501e0ad439b3'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:06 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:06 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:07 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Deleted volume successfully. Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4874762d-5bfb-4ffe-bc52-d26bc5c657bd tempest-VolumesServicesTestJSON-1825019568 None] Lock "cinder-f5e586cc-8dc9-4406-a26a-127df5f13060-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Acquiring lock "cinder-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Acquiring lock "cinder-quobyte-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-quobyte-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbfdecb-4140-4198-b85b-863b1014d8fe]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:07 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 Jul 29 16:08:07 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:07 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:07 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9 Jul 29 16:08:07 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:08 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9" returned: 0 in 0.293s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-quobyte-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9" released by "delete_volume" :: held 0.778s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Created reservations ['bb42aa7e-ce36-4cd6-854f-a4fa67cad48a', 'f1a6fcfd-52c7-4df9-b2b3-0a6cdc97b568', 'c4ecf8c0-14e8-4f80-8fb5-07ad26c7c9d8', '1d9224ff-47a0-46a0-8917-5ae215fc016c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:08 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:08 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:08 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.507s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:08 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Deleted volume successfully. Jul 29 16:08:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-422b2125-59f4-4395-903a-adb48f281399 tempest-VolumesTransfersTest-2068295896 None] Lock "cinder-f6cc7cfc-c1a2-4a1b-a1ae-c318bbabbdb9-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Flow 'volume_create_manager' (fde846d4-4ba8-4dd9-861b-f554ae94ca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652238ff-7cfe-4ffb-b30a-c529924f915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652238ff-7cfe-4ffb-b30a-c529924f915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1155804353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef43ef0-0e3d-4d17-ac34-13d0a1a69189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e02e306217b849b3bc5cd95fb934eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:15Z,use_quota=True,user_id='32b3a872dce6419ab3a0f3b4bd60e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393883b3-a927-4f1a-b5c2-1cb82f1e5bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393883b3-a927-4f1a-b5c2-1cb82f1e5bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ab02b9-0f12-41be-b905-d0e464703200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ab02b9-0f12-41be-b905-d0e464703200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef43ef0-0e3d-4d17-ac34-13d0a1a69189', 'volume_name': 'volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abf260b-5a24-46e6-a9d5-56694df9f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abf260b-5a24-46e6-a9d5-56694df9f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1b33e0-d099-481d-9d30-a7a02007892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Volume fef43ef0-0e3d-4d17-ac34-13d0a1a69189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189', 'volume_size': 1} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1155804353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef43ef0-0e3d-4d17-ac34-13d0a1a69189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e02e306217b849b3bc5cd95fb934eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:15Z,use_quota=True,user_id='32b3a872dce6419ab3a0f3b4bd60e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Creating volume fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:15 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:15 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 1073741824 Jul 29 16:08:15 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:16 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 1073741824" returned: 0 in 0.663s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:16 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 Jul 29 16:08:16 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:16 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" returned: 0 in 0.296s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1b33e0-d099-481d-9d30-a7a02007892d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcee7da4-c86f-406a-a988-9c5344196bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:16 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Volume volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 (fef43ef0-0e3d-4d17-ac34-13d0a1a69189): created successfully Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcee7da4-c86f-406a-a988-9c5344196bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Flow 'volume_create_manager' (fde846d4-4ba8-4dd9-861b-f554ae94ca22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-be884a80-c8c7-4cde-b057-3b5a2c4ea367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Created volume successfully. Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Flow 'volume_create_manager' (ef529284-c50d-4895-9271-5fde12c695a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070a6e7-fd04-4506-ab74-4ba0fc71c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070a6e7-fd04-4506-ab74-4ba0fc71c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-730220605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0c265-6513-4cf3-8b74-0b54758ba415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee5a48f3b874b41947508ddeccea542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:17Z,use_quota=True,user_id='13d3955bdc7e487dbfb3256a6dc9727e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f976c619-5362-4d97-b68e-aadc9813c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f976c619-5362-4d97-b68e-aadc9813c07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14b00a5-db5c-4e75-9251-9a6b31577afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14b00a5-db5c-4e75-9251-9a6b31577afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a0c265-6513-4cf3-8b74-0b54758ba415', 'volume_name': 'volume-81a0c265-6513-4cf3-8b74-0b54758ba415', 'volume_size': 2}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20dfeb6-7e92-434d-be02-a73e5b7a0c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20dfeb6-7e92-434d-be02-a73e5b7a0c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f4be01-3b0e-4163-a662-3ca3f81a23a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Volume 81a0c265-6513-4cf3-8b74-0b54758ba415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a0c265-6513-4cf3-8b74-0b54758ba415', 'volume_size': 2} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-730220605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0c265-6513-4cf3-8b74-0b54758ba415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee5a48f3b874b41947508ddeccea542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:17Z,use_quota=True,user_id='13d3955bdc7e487dbfb3256a6dc9727e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Creating volume 81a0c265-6513-4cf3-8b74-0b54758ba415 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:17 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 2147483648 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:17 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 2147483648 Jul 29 16:08:17 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:17 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 2147483648" returned: 0 in 0.655s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:17 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 Jul 29 16:08:17 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:18 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415" returned: 0 in 0.362s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.457s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f4be01-3b0e-4163-a662-3ca3f81a23a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a0c265-6513-4cf3-8b74-0b54758ba415', 'volume_size': 2}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c714ed-58d1-4059-84ef-6851822abd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Creating offline snapshot 8166da82-db7c-44d8-8464-981edac5e8e3 of volume fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:08:18 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Volume volume-81a0c265-6513-4cf3-8b74-0b54758ba415 (81a0c265-6513-4cf3-8b74-0b54758ba415): created successfully Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c714ed-58d1-4059-84ef-6851822abd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Flow 'volume_create_manager' (ef529284-c50d-4895-9271-5fde12c695a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff92e41-cab2-4352-b154-307066198d88]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b39e6007-e179-400b-9cc4-e2289abc6608 tempest-VolumesCloneNegativeTest-928047845 None] Created volume successfully. Jul 29 16:08:18 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 Jul 29 16:08:18 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:18 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" returned: 0 in 0.454s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:18 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 1G Jul 29 16:08:18 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:19 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 1G" returned: 0 in 0.550s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:19 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 Jul 29 16:08:19 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Acquiring lock "cinder-81a0c265-6513-4cf3-8b74-0b54758ba415-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Lock "cinder-81a0c265-6513-4cf3-8b74-0b54758ba415-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Acquiring lock "cinder-quobyte-81a0c265-6513-4cf3-8b74-0b54758ba415" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Lock "cinder-quobyte-81a0c265-6513-4cf3-8b74-0b54758ba415" acquired by "delete_volume" :: waited 0.038s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b56407-e889-4bea-aacb-aa47c98a9a28]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:19 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 Jul 29 16:08:19 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:19 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3" returned: 0 in 0.400s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:19 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 is being set with open permissions: ugo+rw Jul 29 16:08:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:19 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 Jul 29 16:08:19 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:20 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415" returned: 0 in 0.448s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:20 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3" returned: 0 in 0.310s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:20 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415 Jul 29 16:08:20 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:20 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info Jul 29 16:08:20 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:20 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:20 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info" returned: 0 in 0.305s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-81a0c265-6513-4cf3-8b74-0b54758ba415" returned: 0 in 0.361s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:20 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info is being set with open permissions: ugo+rw Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Lock "cinder-quobyte-81a0c265-6513-4cf3-8b74-0b54758ba415" released by "delete_volume" :: held 0.881s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:20 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info Jul 29 16:08:20 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Created reservations ['d8a8682e-0091-4516-b34f-20a94445a643', '6775f4be-632e-44dd-9fd3-49eb7b0261cf', 'b00fa292-5128-4893-99d8-d4da974a68be', 'c6b2d81b-6de0-429d-9559-7f6f440ad617'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:20 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.info" returned: 0 in 0.347s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:20 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:20 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fab5bb12-bbb5-4fb1-8d20-f8c2fe8fb352 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Create snapshot completed successfully Jul 29 16:08:21 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.302s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Deleted volume successfully. Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8bfaf9fc-d3ec-487b-b566-04807a4298bd tempest-VolumesCloneNegativeTest-928047845 None] Lock "cinder-81a0c265-6513-4cf3-8b74-0b54758ba415-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "cinder-8166da82-db7c-44d8-8464-981edac5e8e3-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-8166da82-db7c-44d8-8464-981edac5e8e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "cinder-quobyte-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-quobyte-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "cinder-quobyte-8166da82-db7c-44d8-8464-981edac5e8e3" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-quobyte-8166da82-db7c-44d8-8464-981edac5e8e3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Deleting offline snapshot 8166da82-db7c-44d8-8464-981edac5e8e3 of volume fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] snapshot_file for this snap is: volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f5d15-7243-41e7-a018-46b710d81397]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:22 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 Jul 29 16:08:22 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:22 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3" returned: 0 in 0.652s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:08:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[45449c92-8246-4f8e-99fe-3907136333b4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:22 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 Jul 29 16:08:22 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:23 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" returned: 0 in 0.458s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:23 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 Jul 29 16:08:23 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:23 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3" returned: 0 in 0.460s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:23 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3 Jul 29 16:08:23 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:23 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189.8166da82-db7c-44d8-8464-981edac5e8e3" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-quobyte-8166da82-db7c-44d8-8464-981edac5e8e3" released by "_delete_snapshot" :: held 2.192s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-quobyte-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" released by "delete_snapshot" :: held 2.226s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Created reservations ['14717759-9339-47b9-9457-9e92f9c88090', 'bae1c0ed-2409-421e-94ff-be5d8b459368', '466ea42f-f9e6-46fd-997d-ee496806780e', '84bb8aba-5f59-48c1-8293-75246fd633bf'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Delete snapshot completed successfully. Jul 29 16:08:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6b036539-5bc7-491a-88c9-2882923c3ca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-8166da82-db7c-44d8-8464-981edac5e8e3-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "cinder-fef43ef0-0e3d-4d17-ac34-13d0a1a69189-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-fef43ef0-0e3d-4d17-ac34-13d0a1a69189-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "cinder-quobyte-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-quobyte-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e458e6-94e3-49a0-b295-fb537d2f830a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:25 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 Jul 29 16:08:25 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" returned: 0 in 0.589s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:25 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:25 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189 Jul 29 16:08:25 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:26 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" returned: 0 in 0.336s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-quobyte-fef43ef0-0e3d-4d17-ac34-13d0a1a69189" released by "delete_volume" :: held 1.008s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (92632106-1346-4635-a03d-b35e70ed9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120be581-6fe5-4b2d-bcff-fea02b73c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120be581-6fe5-4b2d-bcff-fea02b73c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-559261247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab58884d-96d6-42ae-83b4-ae6664559159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:26Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37af2eee-f362-4565-bdce-29b576d1f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37af2eee-f362-4565-bdce-29b576d1f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679d38f4-b85c-4a2e-9b8b-9b46ff078f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679d38f4-b85c-4a2e-9b8b-9b46ff078f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab58884d-96d6-42ae-83b4-ae6664559159', 'volume_name': 'volume-ab58884d-96d6-42ae-83b4-ae6664559159', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecae322-3fc4-4f1f-bfbc-6515fc43b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecae322-3fc4-4f1f-bfbc-6515fc43b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5465cc4-61b6-4d43-b8ca-2f7cf82a47bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Volume ab58884d-96d6-42ae-83b4-ae6664559159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab58884d-96d6-42ae-83b4-ae6664559159', 'volume_size': 1} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-559261247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab58884d-96d6-42ae-83b4-ae6664559159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:26Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Creating volume ab58884d-96d6-42ae-83b4-ae6664559159 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:26 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:26 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 1073741824 Jul 29 16:08:26 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Flow 'volume_create_manager' (045d3592-021c-4ce9-a51a-5775a583b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32af7e34-3085-4102-a883-b6acfa2d41e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32af7e34-3085-4102-a883-b6acfa2d41e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-363498416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f96c8b-ce42-46f4-85f0-18ab9d54daff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0232c094df884630a4b57844c79161df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:26Z,use_quota=True,user_id='fc93599a5cd04710bb2d010cad026229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fac982-24c9-4500-9cab-f59015cde34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fac982-24c9-4500-9cab-f59015cde34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e814db3-424d-4984-889e-bc15104c6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e814db3-424d-4984-889e-bc15104c6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f96c8b-ce42-46f4-85f0-18ab9d54daff', 'volume_name': 'volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf7d86e-7eda-4e1f-957e-ae93d011ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf7d86e-7eda-4e1f-957e-ae93d011ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08193af-10eb-44b8-8c37-065d9939283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Volume e6f96c8b-ce42-46f4-85f0-18ab9d54daff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff', 'volume_size': 1} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Created reservations ['4278ba97-9f20-4195-95b4-e767d6c33ed6', '2626f662-137e-4c92-ad19-cc0f7c79eea7', 'f14789fc-30eb-4196-8dac-befe38ddef04', '74e98fce-1de0-4378-b503-3f80c86854be'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:26 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:26 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:26 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.422s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:26 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:27 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 1073741824" returned: 0 in 0.665s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:27 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Deleted volume successfully. Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-46ba3d38-a9c7-4e71-8203-c175edc45858 tempest-VolumeSnapshotQuotasNegativeTestJSON-2033187681 None] Lock "cinder-fef43ef0-0e3d-4d17-ac34-13d0a1a69189-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:27 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 Jul 29 16:08:27 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:27 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-363498416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f96c8b-ce42-46f4-85f0-18ab9d54daff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0232c094df884630a4b57844c79161df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:26Z,use_quota=True,user_id='fc93599a5cd04710bb2d010cad026229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Creating volume e6f96c8b-ce42-46f4-85f0-18ab9d54daff {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:27 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5465cc4-61b6-4d43-b8ca-2f7cf82a47bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab58884d-96d6-42ae-83b4-ae6664559159', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:27 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff 1073741824 Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f3890e-2a45-404e-ab12-38ba717d3aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:27 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:27 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Volume volume-ab58884d-96d6-42ae-83b4-ae6664559159 (ab58884d-96d6-42ae-83b4-ae6664559159): created successfully Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f3890e-2a45-404e-ab12-38ba717d3aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (92632106-1346-4635-a03d-b35e70ed9784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:27 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-80741377-f179-479a-b756-70dbb3b0753f tempest-VolumesActionsTest-493650824 None] Created volume successfully. Jul 29 16:08:27 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff 1073741824" returned: 0 in 0.560s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:28 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff Jul 29 16:08:28 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c95f46e-ca0c-4d2d-bd02-54db054d8f38 tempest-VolumesActionsTest-493650824 None] Acquiring lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159" by "attach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c95f46e-ca0c-4d2d-bd02-54db054d8f38 tempest-VolumesActionsTest-493650824 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159" acquired by "attach_volume" :: waited 0.039s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7c95f46e-ca0c-4d2d-bd02-54db054d8f38 tempest-VolumesActionsTest-493650824 None] Attaching volume ab58884d-96d6-42ae-83b4-ae6664559159 to instance 523e7f20-9560-43be-b0da-6bcf3aee0fde at mountpoint /dev/vdb on host None. Jul 29 16:08:28 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08193af-10eb-44b8-8c37-065d9939283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395e6fcd-c9a7-43c8-a5e9-2b559469d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7c95f46e-ca0c-4d2d-bd02-54db054d8f38 tempest-VolumesActionsTest-493650824 None] Attach volume completed successfully. Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c95f46e-ca0c-4d2d-bd02-54db054d8f38 tempest-VolumesActionsTest-493650824 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159" released by "attach_volume" :: held 0.190s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:28 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Volume volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff (e6f96c8b-ce42-46f4-85f0-18ab9d54daff): created successfully Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395e6fcd-c9a7-43c8-a5e9-2b559469d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Flow 'volume_create_manager' (045d3592-021c-4ce9-a51a-5775a583b980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d11d5375-aabf-47b6-ba12-09dde81c2871 tempest-VolumesNegativeTest-322987240 None] Created volume successfully. Jul 29 16:08:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a670b9be-9f94-4fb5-90b8-f3ab8bc87715 tempest-VolumesActionsTest-393833462 None] Terminate volume connection completed successfully. Jul 29 16:08:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a670b9be-9f94-4fb5-90b8-f3ab8bc87715 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-detach_volume" by "detach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a670b9be-9f94-4fb5-90b8-f3ab8bc87715 tempest-VolumesActionsTest-393833462 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a670b9be-9f94-4fb5-90b8-f3ab8bc87715 tempest-VolumesActionsTest-393833462 None] Detaching volume ab58884d-96d6-42ae-83b4-ae6664559159 from instance 523e7f20-9560-43be-b0da-6bcf3aee0fde. Jul 29 16:08:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a670b9be-9f94-4fb5-90b8-f3ab8bc87715 tempest-VolumesActionsTest-393833462 None] Detach volume completed successfully. Jul 29 16:08:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a670b9be-9f94-4fb5-90b8-f3ab8bc87715 tempest-VolumesActionsTest-393833462 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-detach_volume" released by "detach_volume" :: held 0.294s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac55ae09-cadd-468f-a3d8-7c39fccadd64 tempest-VolumesActionsTest-493650824 None] Acquiring lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-detach_volume" by "detach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac55ae09-cadd-468f-a3d8-7c39fccadd64 tempest-VolumesActionsTest-493650824 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ac55ae09-cadd-468f-a3d8-7c39fccadd64 tempest-VolumesActionsTest-493650824 None] Volume detach called, but volume not attached. Jul 29 16:08:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac55ae09-cadd-468f-a3d8-7c39fccadd64 tempest-VolumesActionsTest-493650824 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Acquiring lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Acquiring lock "cinder-quobyte-ab58884d-96d6-42ae-83b4-ae6664559159" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Lock "cinder-quobyte-ab58884d-96d6-42ae-83b4-ae6664559159" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:30 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db44710-c076-4071-af7f-db13cd124789]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:30 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 Jul 29 16:08:30 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:31 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159" returned: 0 in 0.658s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:31 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159 Jul 29 16:08:31 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:31 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ab58884d-96d6-42ae-83b4-ae6664559159" returned: 0 in 0.641s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Lock "cinder-quobyte-ab58884d-96d6-42ae-83b4-ae6664559159" released by "delete_volume" :: held 1.386s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Created reservations ['20f48b1d-85e0-4046-b35e-feb9c2fe5435', 'a09fe9b8-c0c8-4399-bdb3-ea2a40f87155', '2cde3ba7-75bb-4f2f-b941-d2676bd1ff16', '55885277-6922-48ef-a4c2-e22332aabd61'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:32 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:32 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:32 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.534s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:32 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Deleted volume successfully. Jul 29 16:08:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96daea41-1467-4da4-9e4b-f6973112807d tempest-VolumesActionsTest-493650824 None] Lock "cinder-ab58884d-96d6-42ae-83b4-ae6664559159-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:36 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:36 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:37 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.456s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=127,cinder:DELETE=11 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=99,cinder:INSERT=37,cinder:UPDATE=114,cinder:DELETE=7 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (fed437de-3918-4cf7-87b5-b4afbf419e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d82c6f0-9d93-4b40-8b2f-38648e84ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d82c6f0-9d93-4b40-8b2f-38648e84ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120163376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d561c8-11cf-4513-9c22-f6cea808938c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:37Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f34ea71-1a0e-44c2-8e76-680566f15b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f34ea71-1a0e-44c2-8e76-680566f15b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65309550-fd7e-4c16-9f1f-afa8320d1664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65309550-fd7e-4c16-9f1f-afa8320d1664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d561c8-11cf-4513-9c22-f6cea808938c', 'volume_name': 'volume-f3d561c8-11cf-4513-9c22-f6cea808938c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62009361-e51a-4878-b298-cdb4d333212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62009361-e51a-4878-b298-cdb4d333212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb19fe9-de64-4e08-b983-a527ce81d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Volume f3d561c8-11cf-4513-9c22-f6cea808938c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d561c8-11cf-4513-9c22-f6cea808938c', 'volume_size': 1} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120163376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d561c8-11cf-4513-9c22-f6cea808938c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:37Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Creating volume f3d561c8-11cf-4513-9c22-f6cea808938c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:37 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:37 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c 1073741824 Jul 29 16:08:37 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:38 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c 1073741824" returned: 0 in 0.945s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:38 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c Jul 29 16:08:38 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:38 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c" returned: 0 in 0.344s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb19fe9-de64-4e08-b983-a527ce81d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d561c8-11cf-4513-9c22-f6cea808938c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1e0d6b-e767-440f-a1ac-029632c24a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Volume volume-f3d561c8-11cf-4513-9c22-f6cea808938c (f3d561c8-11cf-4513-9c22-f6cea808938c): created successfully Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1e0d6b-e767-440f-a1ac-029632c24a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (fed437de-3918-4cf7-87b5-b4afbf419e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0b970bef-4671-4478-863a-97cda20f1228 tempest-VolumesActionsTest-493650824 None] Created volume successfully. Jul 29 16:08:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-f3d561c8-11cf-4513-9c22-f6cea808938c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-f3d561c8-11cf-4513-9c22-f6cea808938c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-quobyte-f3d561c8-11cf-4513-9c22-f6cea808938c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-f3d561c8-11cf-4513-9c22-f6cea808938c" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00e477-7d13-447a-8683-75e1b1622ce7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:39 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c Jul 29 16:08:39 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:40 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c" returned: 0 in 0.471s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:40 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c Jul 29 16:08:40 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:40 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f3d561c8-11cf-4513-9c22-f6cea808938c" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-f3d561c8-11cf-4513-9c22-f6cea808938c" released by "delete_volume" :: held 0.935s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Created reservations ['bec91031-6467-46a8-a347-bd469cfaa447', 'bb5d3243-e61f-4ac6-88f2-c283dc7f7cdf', 'b40207d5-cc4d-41ee-922b-ffdb97f76185', '568221e0-66f2-488f-b34c-fb9289b740cd'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:40 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:40 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:41 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.301s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:41 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Deleted volume successfully. Jul 29 16:08:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8733dfd7-4351-43b0-9527-fb2c12bb76f9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-f3d561c8-11cf-4513-9c22-f6cea808938c-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (ee91533c-3d58-40ac-bd81-0dbe89b9cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf378b0-b450-4a14-a3d8-d6afb64c9777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf378b0-b450-4a14-a3d8-d6afb64c9777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010713517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8568c7bb-071f-4b04-bf23-e357b0e61cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:43Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da69996a-419a-4c11-8890-bf8f5a728108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da69996a-419a-4c11-8890-bf8f5a728108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe1f1c5-0625-41c2-acca-7606467b6a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe1f1c5-0625-41c2-acca-7606467b6a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8568c7bb-071f-4b04-bf23-e357b0e61cce', 'volume_name': 'volume-8568c7bb-071f-4b04-bf23-e357b0e61cce', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f63ea60-5f60-4dfc-bbb4-d90b21904f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f63ea60-5f60-4dfc-bbb4-d90b21904f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5d7f24-79de-4f42-9351-2259097d1090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:42 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Volume 8568c7bb-071f-4b04-bf23-e357b0e61cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8568c7bb-071f-4b04-bf23-e357b0e61cce', 'volume_size': 1} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010713517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8568c7bb-071f-4b04-bf23-e357b0e61cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:43Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Creating volume 8568c7bb-071f-4b04-bf23-e357b0e61cce {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:42 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:43 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce 1073741824 Jul 29 16:08:43 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:43 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce 1073741824" returned: 0 in 0.753s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:43 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce Jul 29 16:08:43 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:44 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce" returned: 0 in 0.303s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5d7f24-79de-4f42-9351-2259097d1090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8568c7bb-071f-4b04-bf23-e357b0e61cce', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff60019-9b35-4f9d-acf4-c7a049b947bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:44 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Volume volume-8568c7bb-071f-4b04-bf23-e357b0e61cce (8568c7bb-071f-4b04-bf23-e357b0e61cce): created successfully Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff60019-9b35-4f9d-acf4-c7a049b947bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (ee91533c-3d58-40ac-bd81-0dbe89b9cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-18d447eb-ecc1-45ef-8f97-7ea848377dae tempest-VolumesActionsTest-493650824 None] Created volume successfully. Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-8568c7bb-071f-4b04-bf23-e357b0e61cce-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Lock "cinder-8568c7bb-071f-4b04-bf23-e357b0e61cce-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Flow 'volume_create_manager' (0f0cf860-28b8-4004-9a10-4b3b4d84c3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41021a62-8fdb-4eac-93a5-851491485a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41021a62-8fdb-4eac-93a5-851491485a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1096806154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9469a07-4a5f-4ea3-84b7-49d22a9566d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3948e4ba034a05ab522403a4e49573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:45Z,use_quota=True,user_id='ffe6e496a76348c187bba66924d6f21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc7b22-7b95-42ac-81bb-da4268217558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc7b22-7b95-42ac-81bb-da4268217558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29476361-e3ca-4fc4-8413-4445d8441601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29476361-e3ca-4fc4-8413-4445d8441601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9469a07-4a5f-4ea3-84b7-49d22a9566d4', 'volume_name': 'volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40b9252-c2e9-44e2-8063-b4c670a1ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40b9252-c2e9-44e2-8063-b4c670a1ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0913fc-b3c5-4e7e-95b9-d27c1bff5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:45 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Volume d9469a07-4a5f-4ea3-84b7-49d22a9566d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4', 'volume_size': 1} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1096806154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9469a07-4a5f-4ea3-84b7-49d22a9566d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3948e4ba034a05ab522403a4e49573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:45Z,use_quota=True,user_id='ffe6e496a76348c187bba66924d6f21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Creating volume d9469a07-4a5f-4ea3-84b7-49d22a9566d4 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:45 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-quobyte-8568c7bb-071f-4b04-bf23-e357b0e61cce" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:45 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 1073741824 Jul 29 16:08:45 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-8568c7bb-071f-4b04-bf23-e357b0e61cce" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1991c4-be3f-4957-b65a-ee589d22669b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:45 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce Jul 29 16:08:45 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:45 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce" returned: 0 in 0.398s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:45 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce Jul 29 16:08:45 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:45 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 1073741824" returned: 0 in 0.511s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:45 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 Jul 29 16:08:45 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:45 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8568c7bb-071f-4b04-bf23-e357b0e61cce" returned: 0 in 0.256s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-8568c7bb-071f-4b04-bf23-e357b0e61cce" released by "delete_volume" :: held 0.711s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Created reservations ['6db97951-bcea-4535-891c-cbf76433a44c', 'ddc8e6bf-3cb8-4342-931e-792580af8a2e', '318e02fb-b167-470b-b75f-144566c3a24c', 'df47eafb-5d55-4a77-8c3a-c9d060f5608e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:46 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0913fc-b3c5-4e7e-95b9-d27c1bff5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995cbd2c-9ae3-4de8-a48c-ea786c6d2236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:46 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Volume volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 (d9469a07-4a5f-4ea3-84b7-49d22a9566d4): created successfully Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995cbd2c-9ae3-4de8-a48c-ea786c6d2236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Flow 'volume_create_manager' (0f0cf860-28b8-4004-9a10-4b3b4d84c3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-348c2606-39e1-4320-8702-32cbc196dfee tempest-VolumesListAdminTestJSON-659215373 None] Created volume successfully. Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:46 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:46 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:46 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.250s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Deleted volume successfully. Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ea0ba9f-6248-4e83-aaf6-b5d870002e48 tempest-VolumesActionsTest-393833462 None] Lock "cinder-8568c7bb-071f-4b04-bf23-e357b0e61cce-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (9a694b65-137b-4423-a291-cb4e1044e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5eaf1a-5012-4c53-9214-abd696f71ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5eaf1a-5012-4c53-9214-abd696f71ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2126542177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63163e63-680b-4a2f-b463-78c2bf509752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:47Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f2eeae-2524-4f85-8204-0c3531657f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f2eeae-2524-4f85-8204-0c3531657f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b810d4-0d8a-4e54-9f24-72f149894216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b810d4-0d8a-4e54-9f24-72f149894216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63163e63-680b-4a2f-b463-78c2bf509752', 'volume_name': 'volume-63163e63-680b-4a2f-b463-78c2bf509752', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb3a4b2-4c3a-42cf-a49a-6659c7033c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb3a4b2-4c3a-42cf-a49a-6659c7033c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26ccefd-d67b-478a-90ac-35a96a72e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:46 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Volume 63163e63-680b-4a2f-b463-78c2bf509752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63163e63-680b-4a2f-b463-78c2bf509752', 'volume_size': 1} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2126542177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63163e63-680b-4a2f-b463-78c2bf509752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:47Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Creating volume 63163e63-680b-4a2f-b463-78c2bf509752 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:46 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:46 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 1073741824 Jul 29 16:08:46 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:47 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 1073741824" returned: 0 in 0.542s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:47 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 Jul 29 16:08:47 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:47 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752" returned: 0 in 0.313s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26ccefd-d67b-478a-90ac-35a96a72e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63163e63-680b-4a2f-b463-78c2bf509752', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c631e6-c815-4b46-b8bb-c81a75aca76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:47 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Volume volume-63163e63-680b-4a2f-b463-78c2bf509752 (63163e63-680b-4a2f-b463-78c2bf509752): created successfully Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c631e6-c815-4b46-b8bb-c81a75aca76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (9a694b65-137b-4423-a291-cb4e1044e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-717e5b78-6b38-45f6-a9df-8ba11647f2ed tempest-VolumesActionsTest-493650824 None] Created volume successfully. Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Flow 'volume_create_manager' (1387208d-af37-47e3-8faa-ea695ced1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724fe104-1310-4d5d-808a-5a171c84de9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724fe104-1310-4d5d-808a-5a171c84de9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-471527391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a12a1a-a1fa-48da-95da-b7b486cd83bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3948e4ba034a05ab522403a4e49573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:48Z,use_quota=True,user_id='ffe6e496a76348c187bba66924d6f21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d87fce-a071-405c-9214-0802d45da188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d87fce-a071-405c-9214-0802d45da188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bc019b-25af-457e-957e-44b28d6b8934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bc019b-25af-457e-957e-44b28d6b8934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a12a1a-a1fa-48da-95da-b7b486cd83bb', 'volume_name': 'volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3728c31-e51a-4fb8-9399-7b6b6a938b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3728c31-e51a-4fb8-9399-7b6b6a938b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db0413d-bba0-46e0-a8ab-36a7e2dc2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:47 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Volume 95a12a1a-a1fa-48da-95da-b7b486cd83bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb', 'volume_size': 1} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-471527391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a12a1a-a1fa-48da-95da-b7b486cd83bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3948e4ba034a05ab522403a4e49573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:48Z,use_quota=True,user_id='ffe6e496a76348c187bba66924d6f21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Creating volume 95a12a1a-a1fa-48da-95da-b7b486cd83bb {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:47 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:47 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb 1073741824 Jul 29 16:08:47 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:48 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb 1073741824" returned: 0 in 0.460s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:48 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb Jul 29 16:08:48 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:48 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb" returned: 0 in 0.260s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db0413d-bba0-46e0-a8ab-36a7e2dc2169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d37e12f-5f41-4882-936e-b7c3f87e0207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:48 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Volume volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb (95a12a1a-a1fa-48da-95da-b7b486cd83bb): created successfully Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d37e12f-5f41-4882-936e-b7c3f87e0207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Flow 'volume_create_manager' (1387208d-af37-47e3-8faa-ea695ced1252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2aca0c95-d9e7-453c-a0a7-ffa00c504ff6 tempest-VolumesListAdminTestJSON-659215373 None] Created volume successfully. Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-63163e63-680b-4a2f-b463-78c2bf509752-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Lock "cinder-63163e63-680b-4a2f-b463-78c2bf509752-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-quobyte-63163e63-680b-4a2f-b463-78c2bf509752" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-63163e63-680b-4a2f-b463-78c2bf509752" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f012c-8a6c-4fa7-9309-33d9f3485f60]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:49 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 Jul 29 16:08:49 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:49 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752" returned: 0 in 0.402s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:49 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752 Jul 29 16:08:49 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:49 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-63163e63-680b-4a2f-b463-78c2bf509752" returned: 0 in 0.265s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-63163e63-680b-4a2f-b463-78c2bf509752" released by "delete_volume" :: held 0.714s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Created reservations ['346a1183-bcf3-47fc-8e34-5368167e882e', '9cf6212c-809f-4584-bad1-5480fabad643', '85067802-31d0-4cd0-9670-90d57501ecc1', 'd91a713d-5436-4953-b993-976300fb7df9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:50 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:50 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:50 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.340s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Deleted volume successfully. Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19d0fb20-4c50-49a9-961a-49118d47055a tempest-VolumesActionsTest-393833462 None] Lock "cinder-63163e63-680b-4a2f-b463-78c2bf509752-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Flow 'volume_create_manager' (8d7c7094-e5bc-4d45-a431-daaea601e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcab4fd-dd0e-4f81-aa04-64342baa7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcab4fd-dd0e-4f81-aa04-64342baa7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1411519550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d525f4a-d259-4612-bcb6-eb7f150a140f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3948e4ba034a05ab522403a4e49573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:50Z,use_quota=True,user_id='ffe6e496a76348c187bba66924d6f21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d3d1b7-73b6-4017-a4f6-3e70d1147c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d3d1b7-73b6-4017-a4f6-3e70d1147c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59d0c63-ad1d-498e-a514-65d9a58bb3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59d0c63-ad1d-498e-a514-65d9a58bb3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d525f4a-d259-4612-bcb6-eb7f150a140f', 'volume_name': 'volume-6d525f4a-d259-4612-bcb6-eb7f150a140f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccfed05-4116-48a1-a8d5-3615c1a7ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccfed05-4116-48a1-a8d5-3615c1a7ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b23fff6-5624-4428-99cd-f8b517cb9187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Volume 6d525f4a-d259-4612-bcb6-eb7f150a140f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d525f4a-d259-4612-bcb6-eb7f150a140f', 'volume_size': 1} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1411519550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d525f4a-d259-4612-bcb6-eb7f150a140f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3948e4ba034a05ab522403a4e49573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:50Z,use_quota=True,user_id='ffe6e496a76348c187bba66924d6f21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Creating volume 6d525f4a-d259-4612-bcb6-eb7f150a140f {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:50 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:50 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f 1073741824 Jul 29 16:08:50 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (6db4b1d9-5f44-4110-baa7-cf269c260b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea861e3f-9df0-436f-a525-0f6dac3ea935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea861e3f-9df0-436f-a525-0f6dac3ea935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-518134779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e72e90-9767-42fc-8901-eb2e4eb52f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:51Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0493a232-7793-409e-813e-a95e679237a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0493a232-7793-409e-813e-a95e679237a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe4fcc2-cd11-43c5-bf46-2ca4968cc196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe4fcc2-cd11-43c5-bf46-2ca4968cc196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e72e90-9767-42fc-8901-eb2e4eb52f6b', 'volume_name': 'volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b72b6e-09c5-4910-a94f-6e15dea29152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b72b6e-09c5-4910-a94f-6e15dea29152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634cc1d2-17ef-46db-9417-1334ee075d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Volume e2e72e90-9767-42fc-8901-eb2e4eb52f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b', 'volume_size': 1} Jul 29 16:08:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:51 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f 1073741824" returned: 0 in 0.479s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:51 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f Jul 29 16:08:51 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:51 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f" returned: 0 in 0.284s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-518134779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e72e90-9767-42fc-8901-eb2e4eb52f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:51Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Creating volume e2e72e90-9767-42fc-8901-eb2e4eb52f6b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:51 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:51 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b 1073741824 Jul 29 16:08:51 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b23fff6-5624-4428-99cd-f8b517cb9187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d525f4a-d259-4612-bcb6-eb7f150a140f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de67a19-bb32-49d5-b501-ba9e2f55f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:51 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Volume volume-6d525f4a-d259-4612-bcb6-eb7f150a140f (6d525f4a-d259-4612-bcb6-eb7f150a140f): created successfully Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de67a19-bb32-49d5-b501-ba9e2f55f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Flow 'volume_create_manager' (8d7c7094-e5bc-4d45-a431-daaea601e554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-47f05f8b-0e06-4fdb-88ef-3cf5610454b2 tempest-VolumesListAdminTestJSON-659215373 None] Created volume successfully. Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Acquiring lock "cinder-e6f96c8b-ce42-46f4-85f0-18ab9d54daff-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Lock "cinder-e6f96c8b-ce42-46f4-85f0-18ab9d54daff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Acquiring lock "cinder-quobyte-e6f96c8b-ce42-46f4-85f0-18ab9d54daff" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Lock "cinder-quobyte-e6f96c8b-ce42-46f4-85f0-18ab9d54daff" acquired by "delete_volume" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd265f-00b7-4434-b91d-5460d3261c7a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:51 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff Jul 29 16:08:51 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:51 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b 1073741824" returned: 0 in 0.467s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:52 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b Jul 29 16:08:52 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:52 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff" returned: 0 in 0.405s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:52 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff Jul 29 16:08:52 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:52 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b" returned: 0 in 0.257s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634cc1d2-17ef-46db-9417-1334ee075d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78a0ed-f2a9-4db2-aeba-7f337adeec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:52 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Volume volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b (e2e72e90-9767-42fc-8901-eb2e4eb52f6b): created successfully Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78a0ed-f2a9-4db2-aeba-7f337adeec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (6db4b1d9-5f44-4110-baa7-cf269c260b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-072dd56a-7884-4a6a-b4bf-15875fe0a2e0 tempest-VolumesActionsTest-493650824 None] Created volume successfully. Jul 29 16:08:52 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e6f96c8b-ce42-46f4-85f0-18ab9d54daff" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Lock "cinder-quobyte-e6f96c8b-ce42-46f4-85f0-18ab9d54daff" released by "delete_volume" :: held 0.698s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Created reservations ['3873c92d-5e64-4c1d-92fd-84c1c345adf5', '5970e6ec-a18b-4122-9b17-3413c067bfcb', 'c67dda1f-1077-4e1b-bbd3-8c12fcb0390e', '641712be-51bf-41a0-a404-b3209fb3ac46'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:52 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:52 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:52 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.270s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Deleted volume successfully. Jul 29 16:08:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c3e28098-3c52-4321-b7a0-39bf2c8cdc7f tempest-VolumesNegativeTest-322987240 None] Lock "cinder-e6f96c8b-ce42-46f4-85f0-18ab9d54daff-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-e2e72e90-9767-42fc-8901-eb2e4eb52f6b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-e2e72e90-9767-42fc-8901-eb2e4eb52f6b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Acquiring lock "cinder-quobyte-e2e72e90-9767-42fc-8901-eb2e4eb52f6b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Flow 'volume_create_manager' (954afbf2-2361-474f-aa52-7743f3dc2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243de1c0-1026-4772-a198-7f7df57ac2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-e2e72e90-9767-42fc-8901-eb2e4eb52f6b" acquired by "delete_volume" :: waited 0.056s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243de1c0-1026-4772-a198-7f7df57ac2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be21bd9-cbaf-43fc-96e4-31fc621dc09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a729f9b5f2ce478880811bc9601410f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:53Z,use_quota=True,user_id='1cfcf6c2f9094dfaba36d4db220a54de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7384931a-3e0f-41b9-b79f-ad3e36fdaf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7384931a-3e0f-41b9-b79f-ad3e36fdaf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f4073f-4c29-4dc8-809f-b2e552fb7d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f4073f-4c29-4dc8-809f-b2e552fb7d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be21bd9-cbaf-43fc-96e4-31fc621dc09b', 'volume_name': 'volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef70919-8dd1-4776-b36d-0279f92ea069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef70919-8dd1-4776-b36d-0279f92ea069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101af8fa-5049-44b8-9cb6-2f5f0757c42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:53 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Volume 9be21bd9-cbaf-43fc-96e4-31fc621dc09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b', 'volume_size': 1} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be21bd9-cbaf-43fc-96e4-31fc621dc09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a729f9b5f2ce478880811bc9601410f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:53Z,use_quota=True,user_id='1cfcf6c2f9094dfaba36d4db220a54de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Creating volume 9be21bd9-cbaf-43fc-96e4-31fc621dc09b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:53 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd3224-fb56-40b3-ac75-8fdf73814bfa]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:53 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b 1073741824 Jul 29 16:08:53 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:53 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b Jul 29 16:08:53 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:53 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b" returned: 0 in 0.467s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:53 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b Jul 29 16:08:53 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:54 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b 1073741824" returned: 0 in 0.684s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:54 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b Jul 29 16:08:54 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:54 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2e72e90-9767-42fc-8901-eb2e4eb52f6b" returned: 0 in 0.339s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-quobyte-e2e72e90-9767-42fc-8901-eb2e4eb52f6b" released by "delete_volume" :: held 0.921s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Created reservations ['4ab5a244-ac93-43cc-9c2a-da7e9d60c012', '692263f5-32f8-4227-8137-658d7f1d490e', '5ac61380-83ee-41cf-b6ac-62f6f1eb93f6', 'b2a78abe-1220-42b4-9271-5a7a63f7dd3d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:54 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:54 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:54 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101af8fa-5049-44b8-9cb6-2f5f0757c42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6e99c9-af2e-498d-8afb-00794f7a970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Volume volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b (9be21bd9-cbaf-43fc-96e4-31fc621dc09b): created successfully Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6e99c9-af2e-498d-8afb-00794f7a970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Flow 'volume_create_manager' (954afbf2-2361-474f-aa52-7743f3dc2761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1d633510-6317-4f40-9608-49b1afa28cbf tempest-VolumesListAdminTestJSON-789031273 None] Created volume successfully. Jul 29 16:08:54 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.259s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Deleted volume successfully. Jul 29 16:08:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1e3e726e-08f7-4d76-bcb9-3a33c14c0aa9 tempest-VolumesActionsTest-393833462 None] Lock "cinder-e2e72e90-9767-42fc-8901-eb2e4eb52f6b-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Acquiring lock "cinder-9be21bd9-cbaf-43fc-96e4-31fc621dc09b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Lock "cinder-9be21bd9-cbaf-43fc-96e4-31fc621dc09b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Acquiring lock "cinder-quobyte-9be21bd9-cbaf-43fc-96e4-31fc621dc09b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Lock "cinder-quobyte-9be21bd9-cbaf-43fc-96e4-31fc621dc09b" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eebcaed-bbc8-4b58-b4c9-55b95f42ff56]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "cinder-6d525f4a-d259-4612-bcb6-eb7f150a140f-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-6d525f4a-d259-4612-bcb6-eb7f150a140f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:55 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b Jul 29 16:08:55 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "cinder-quobyte-6d525f4a-d259-4612-bcb6-eb7f150a140f" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-quobyte-6d525f4a-d259-4612-bcb6-eb7f150a140f" acquired by "delete_volume" :: waited 0.040s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[52191d49-d6dc-425c-aa33-2799a70a9d81]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:56 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f Jul 29 16:08:56 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:56 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b" returned: 0 in 0.628s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:56 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b Jul 29 16:08:56 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (4abd15b5-dfb6-4477-bea9-2cfb23d12ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dee79c4-7f47-4666-a0d4-ff6993108d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dee79c4-7f47-4666-a0d4-ff6993108d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-361559970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:56Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551a7d40-b000-433e-96ef-1ddf01343e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551a7d40-b000-433e-96ef-1ddf01343e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb70f54-e7c2-4d98-8937-e4c9b6b4c9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb70f54-e7c2-4d98-8937-e4c9b6b4c9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9', 'volume_name': 'volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f938578f-9b83-4caa-928a-981e602d9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f938578f-9b83-4caa-928a-981e602d9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93742849-77b7-4e10-b8a4-307d5f04ed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:56 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Volume a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9', 'volume_size': 1} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-361559970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b3c7c5546ff8e47ba68b2b978e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:08:56Z,use_quota=True,user_id='d589446d40714a3a9288fc1cf1793171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Creating volume a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:08:56 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:56 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 1073741824 Jul 29 16:08:56 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:56 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f" returned: 0 in 0.707s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:56 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9be21bd9-cbaf-43fc-96e4-31fc621dc09b" returned: 0 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:56 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f Jul 29 16:08:56 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Lock "cinder-quobyte-9be21bd9-cbaf-43fc-96e4-31fc621dc09b" released by "delete_volume" :: held 1.106s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:56 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Created reservations ['77e1860e-1cf0-4397-a7f5-04f1127a31cc', '68755d92-2880-49cf-b39e-4501fc1579ad', '6a39b3e8-8de4-4b6a-9341-7079e3e8a1a4', '8eb860b4-eef3-4a33-99db-d94376c77f87'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:57 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:57 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:57 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6d525f4a-d259-4612-bcb6-eb7f150a140f" returned: 0 in 0.513s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-quobyte-6d525f4a-d259-4612-bcb6-eb7f150a140f" released by "delete_volume" :: held 1.295s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:57 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 1073741824" returned: 0 in 0.784s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Created reservations ['497cffd7-306f-4fbe-8541-9f25c5d58b39', '9a1d11c7-9a61-49e0-9c60-cc47d2c0ac7a', 'c953ce6f-0259-41f4-a1ee-bc1a0472c18b', '8a2429e8-dad9-4b9c-8c7c-51eac87fa96c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:57 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 Jul 29 16:08:57 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:57 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Deleted volume successfully. Jul 29 16:08:57 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:57 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3710330f-8a75-4bc5-87d4-2a6f21447c01 tempest-VolumesListAdminTestJSON-789031273 None] Lock "cinder-9be21bd9-cbaf-43fc-96e4-31fc621dc09b-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:57 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9" returned: 0 in 0.323s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93742849-77b7-4e10-b8a4-307d5f04ed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b93860-e2d0-4687-968d-6b8daf48e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:08:57 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Volume volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 (a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9): created successfully Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b93860-e2d0-4687-968d-6b8daf48e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Flow 'volume_create_manager' (4abd15b5-dfb6-4477-bea9-2cfb23d12ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:08:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2ee41db6-044a-499b-a614-31a43511af8a tempest-VolumesActionsTest-493650824 None] Created volume successfully. Jul 29 16:08:57 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.335s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Deleted volume successfully. Jul 29 16:08:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2a6877fd-84e4-48d7-9544-b560ed3d2d3f tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-6d525f4a-d259-4612-bcb6-eb7f150a140f-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "cinder-95a12a1a-a1fa-48da-95da-b7b486cd83bb-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-95a12a1a-a1fa-48da-95da-b7b486cd83bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "cinder-quobyte-95a12a1a-a1fa-48da-95da-b7b486cd83bb" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-quobyte-95a12a1a-a1fa-48da-95da-b7b486cd83bb" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5369d549-de2f-4fde-a3b4-960fa6076578]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:58 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb Jul 29 16:08:58 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:58 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb" returned: 0 in 0.422s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:58 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb Jul 29 16:08:58 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:58 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-95a12a1a-a1fa-48da-95da-b7b486cd83bb" returned: 0 in 0.299s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-quobyte-95a12a1a-a1fa-48da-95da-b7b486cd83bb" released by "delete_volume" :: held 0.779s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Created reservations ['530ec025-0337-4d3d-bcd1-47d011b925d2', '37c73d7e-a68f-4814-a862-66edd60571ee', '4c407ff9-d733-485a-84cb-ea9713359611', '3bd8d028-2545-442f-a6a1-a100a52dc9b4'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Acquiring lock "cinder-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:59 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:08:59 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Lock "cinder-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Acquiring lock "cinder-quobyte-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Lock "cinder-quobyte-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba4160-54b9-4101-9fd8-c0b03fc9f83d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "cinder-d9469a07-4a5f-4ea3-84b7-49d22a9566d4-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-d9469a07-4a5f-4ea3-84b7-49d22a9566d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:59 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 Jul 29 16:08:59 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "cinder-quobyte-d9469a07-4a5f-4ea3-84b7-49d22a9566d4" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:08:59 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-quobyte-d9469a07-4a5f-4ea3-84b7-49d22a9566d4" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.379s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:08:59 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Deleted volume successfully. Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[59180cac-52c2-4f12-9146-ff1e8ccd93c4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4b20f785-39b3-4831-a23e-435691840c85 tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-95a12a1a-a1fa-48da-95da-b7b486cd83bb-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:08:59 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 Jul 29 16:08:59 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:08:59 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9" returned: 0 in 0.509s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:08:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:08:59 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9 Jul 29 16:08:59 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:00 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4" returned: 0 in 0.521s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:00 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4 Jul 29 16:09:00 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:00 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Lock "cinder-quobyte-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9" released by "delete_volume" :: held 0.893s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Created reservations ['d0863a1c-e6e4-401f-97c3-3e9b301e4cdf', '8bc778f2-d771-4783-b205-b68a0b110acf', '168f76f4-315f-4b64-a628-595e6186e707', '374f376a-78fd-4b07-bb15-abe8ca382e00'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:00 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:09:00 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:00 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d9469a07-4a5f-4ea3-84b7-49d22a9566d4" returned: 0 in 0.343s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-quobyte-d9469a07-4a5f-4ea3-84b7-49d22a9566d4" released by "delete_volume" :: held 0.937s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Created reservations ['8a435b30-849a-40d3-97e2-0484fd9b2fab', '6f203882-ecb4-4b42-b3c8-0fbfe3de38c4', '888b39b5-6ed0-4ef0-868d-3ef3b595569a', '64acdacf-5d3d-4da2-8262-3460cbeb6688'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:00 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:09:00 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:00 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.400s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:09:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Deleted volume successfully. Jul 29 16:09:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3a6cfc6-a037-458d-8e39-890460531038 tempest-VolumesActionsTest-493650824 None] Lock "cinder-a5475a4b-eec3-4df3-ac86-aeb57ef2e6b9-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:01 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.362s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:01 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:09:01 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Deleted volume successfully. Jul 29 16:09:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-af1c1749-052f-439e-b894-bd2ea7d87fbe tempest-VolumesListAdminTestJSON-659215373 None] Lock "cinder-d9469a07-4a5f-4ea3-84b7-49d22a9566d4-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:10 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=76,cinder:UPDATE=89,cinder:INSERT=24,cinder:DELETE=6 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:09:11 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=124,cinder:SELECT=59,cinder:INSERT=25,cinder:DELETE=13 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Flow 'volume_create_manager' (b673e9b0-b011-4a3e-9a20-c2d231f3d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54ba896-3d12-449b-80d5-6b62175428a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54ba896-3d12-449b-80d5-6b62175428a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1542483651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c917691f-ba81-409e-ba0c-2a6a3c9911ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345656766f05456fba7cdf35b7674454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:18Z,use_quota=True,user_id='0e6b2f6573884a578368ce901053766d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf485e3-55cf-48ec-8b44-6b66f052d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf485e3-55cf-48ec-8b44-6b66f052d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef11f55-ad72-4b09-b018-b2bebd095594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef11f55-ad72-4b09-b018-b2bebd095594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c917691f-ba81-409e-ba0c-2a6a3c9911ba', 'volume_name': 'volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99a67f-82fd-41e0-863c-c6a1bd464a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99a67f-82fd-41e0-863c-c6a1bd464a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4461e28e-d0ee-456d-a16a-334de164b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Volume c917691f-ba81-409e-ba0c-2a6a3c9911ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba', 'volume_size': 1} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1542483651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c917691f-ba81-409e-ba0c-2a6a3c9911ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345656766f05456fba7cdf35b7674454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:18Z,use_quota=True,user_id='0e6b2f6573884a578368ce901053766d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Creating volume c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:17 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:17 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba 1073741824 Jul 29 16:09:17 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:18 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba 1073741824" returned: 0 in 0.667s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:18 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba Jul 29 16:09:18 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:18 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4461e28e-d0ee-456d-a16a-334de164b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1386e53-efd5-42a7-9db5-ea5f264d972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:18 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Volume volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba (c917691f-ba81-409e-ba0c-2a6a3c9911ba): created successfully Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1386e53-efd5-42a7-9db5-ea5f264d972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Flow 'volume_create_manager' (b673e9b0-b011-4a3e-9a20-c2d231f3d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3633e825-bf91-4548-9239-3ab020983656 tempest-SnapshotMetadataTestJSON-1173884282 None] Created volume successfully. Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Creating offline snapshot 3297f237-2575-49c2-a1b7-a34367918fa1 of volume c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1961ee6-55d5-4413-a517-f3c0da38d75a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:20 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba Jul 29 16:09:20 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:20 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba" returned: 0 in 0.461s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:20 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 1G Jul 29 16:09:20 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:20 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 1G" returned: 0 in 0.453s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:21 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 Jul 29 16:09:21 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:21 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1" returned: 0 in 0.336s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:21 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 is being set with open permissions: ugo+rw Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:21 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 Jul 29 16:09:21 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:21 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Flow 'volume_create_manager' (a37693ff-01dd-4d74-831b-eda83c61916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b38d9c1-1913-4f65-913d-d3b930bfa345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1" returned: 0 in 0.380s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b38d9c1-1913-4f65-913d-d3b930bfa345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-326903992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e419e581-b65a-46fb-a9f0-fd14fa68a69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e140a3ba5c4deaa16d1ebd72ad4740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:22Z,use_quota=True,user_id='4fb84e2dcdb14fc6ac49b4bbcc202f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31266a8f-5b57-4454-b76c-f80bfe8af6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31266a8f-5b57-4454-b76c-f80bfe8af6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74e83f-abd4-47af-af23-b1039383393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74e83f-abd4-47af-af23-b1039383393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e419e581-b65a-46fb-a9f0-fd14fa68a69b', 'volume_name': 'volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e90c37-b113-4c87-b087-cd236ed2c787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e90c37-b113-4c87-b087-cd236ed2c787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368c5fd0-b542-4b02-b59f-bf36215ec9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Volume e419e581-b65a-46fb-a9f0-fd14fa68a69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b', 'volume_size': 1} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:21 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info Jul 29 16:09:21 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:22 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info" returned: 0 in 0.312s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:22 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info is being set with open permissions: ugo+rw Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:22 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info Jul 29 16:09:22 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Flow 'volume_create_manager' (d7c1fdce-1a92-460d-9e9d-550ef0685d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55e4b06-2acf-44f0-a2b6-36a997760c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55e4b06-2acf-44f0-a2b6-36a997760c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-860201253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8617ad2d-1863-497e-872d-542e26376a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e140a3ba5c4deaa16d1ebd72ad4740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:22Z,use_quota=True,user_id='4fb84e2dcdb14fc6ac49b4bbcc202f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0048bc42-b238-4924-8cbd-0bc4b92181b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0048bc42-b238-4924-8cbd-0bc4b92181b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22312a4-6cb8-4cf8-a3b2-7cd5cb9b415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22312a4-6cb8-4cf8-a3b2-7cd5cb9b415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8617ad2d-1863-497e-872d-542e26376a05', 'volume_name': 'volume-8617ad2d-1863-497e-872d-542e26376a05', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d359ed34-9188-4917-a8bd-d92fd62b8f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d359ed34-9188-4917-a8bd-d92fd62b8f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba0dc03-0eb7-406b-96c0-65c3eefd27c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Volume 8617ad2d-1863-497e-872d-542e26376a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8617ad2d-1863-497e-872d-542e26376a05', 'volume_size': 1} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:22 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.info" returned: 0 in 0.316s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-326903992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e419e581-b65a-46fb-a9f0-fd14fa68a69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e140a3ba5c4deaa16d1ebd72ad4740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:22Z,use_quota=True,user_id='4fb84e2dcdb14fc6ac49b4bbcc202f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Creating volume e419e581-b65a-46fb-a9f0-fd14fa68a69b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:22 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:22 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b 1073741824 Jul 29 16:09:22 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-38cda2c8-21cd-4a43-a648-b6ae9d8416dc tempest-SnapshotMetadataTestJSON-1173884282 None] Create snapshot completed successfully Jul 29 16:09:23 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b 1073741824" returned: 0 in 0.589s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:23 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b Jul 29 16:09:23 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:23 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-860201253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8617ad2d-1863-497e-872d-542e26376a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e140a3ba5c4deaa16d1ebd72ad4740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:22Z,use_quota=True,user_id='4fb84e2dcdb14fc6ac49b4bbcc202f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Creating volume 8617ad2d-1863-497e-872d-542e26376a05 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:23 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:23 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 1073741824 Jul 29 16:09:23 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368c5fd0-b542-4b02-b59f-bf36215ec9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67937b36-6fbb-41a8-ac93-22d55c3e4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:23 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Volume volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b (e419e581-b65a-46fb-a9f0-fd14fa68a69b): created successfully Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67937b36-6fbb-41a8-ac93-22d55c3e4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Flow 'volume_create_manager' (a37693ff-01dd-4d74-831b-eda83c61916a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f8ce5d3e-c8b2-4577-adcc-635947f0237b tempest-TestServerVolumeAttachmentScenario-833121845 None] Created volume successfully. Jul 29 16:09:24 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "cinder-3297f237-2575-49c2-a1b7-a34367918fa1-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 1073741824" returned: 0 in 0.739s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-3297f237-2575-49c2-a1b7-a34367918fa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "cinder-quobyte-c917691f-ba81-409e-ba0c-2a6a3c9911ba" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-quobyte-c917691f-ba81-409e-ba0c-2a6a3c9911ba" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "cinder-quobyte-3297f237-2575-49c2-a1b7-a34367918fa1" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-quobyte-3297f237-2575-49c2-a1b7-a34367918fa1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:24 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 Jul 29 16:09:24 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Deleting offline snapshot 3297f237-2575-49c2-a1b7-a34367918fa1 of volume c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] snapshot_file for this snap is: volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82790c4-e5ba-4dea-be38-deddf6ffc2ac]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:24 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 Jul 29 16:09:24 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:24 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05" returned: 0 in 0.328s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba0dc03-0eb7-406b-96c0-65c3eefd27c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8617ad2d-1863-497e-872d-542e26376a05', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400efb54-b5e0-4522-9382-96d4e173ff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Volume volume-8617ad2d-1863-497e-872d-542e26376a05 (8617ad2d-1863-497e-872d-542e26376a05): created successfully Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400efb54-b5e0-4522-9382-96d4e173ff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Flow 'volume_create_manager' (d7c1fdce-1a92-460d-9e9d-550ef0685d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0b010e19-1252-4c88-b7fe-c2e2764338e1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Created volume successfully. Jul 29 16:09:24 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1" returned: 0 in 0.483s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce62b72-da6c-48f3-a7a4-0bfd6cabd367]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:09:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:25 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba Jul 29 16:09:25 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:25 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:25 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 Jul 29 16:09:25 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:25 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1" returned: 0 in 0.476s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:25 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1 Jul 29 16:09:25 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:26 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba.3297f237-2575-49c2-a1b7-a34367918fa1" returned: 0 in 0.301s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-quobyte-3297f237-2575-49c2-a1b7-a34367918fa1" released by "_delete_snapshot" :: held 1.845s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-quobyte-c917691f-ba81-409e-ba0c-2a6a3c9911ba" released by "delete_snapshot" :: held 1.891s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Created reservations ['4b89e8ab-cc46-4a68-8e45-14274093d7ef', '6a4a258d-a9f9-49a2-baeb-553f69769782', '47a4d5d7-48c1-42a0-bc15-67d0b6791681', '99070af9-ed30-4724-b580-1eb7050d71b9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:09:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Delete snapshot completed successfully. Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b93a8704-b5e3-4cf0-b630-2260e1c24222 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-3297f237-2575-49c2-a1b7-a34367918fa1-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "cinder-c917691f-ba81-409e-ba0c-2a6a3c9911ba-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-c917691f-ba81-409e-ba0c-2a6a3c9911ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "cinder-quobyte-c917691f-ba81-409e-ba0c-2a6a3c9911ba" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-quobyte-c917691f-ba81-409e-ba0c-2a6a3c9911ba" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66160fe-7803-48dc-8594-1618b8babbe0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:09:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:26 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba Jul 29 16:09:26 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:27 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:27 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba Jul 29 16:09:27 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:27 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c917691f-ba81-409e-ba0c-2a6a3c9911ba" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-quobyte-c917691f-ba81-409e-ba0c-2a6a3c9911ba" released by "delete_volume" :: held 0.995s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Created reservations ['f622bb73-3b7d-49cc-ab76-9818e102ed9e', '817a9111-9380-4b80-af71-ad2479bc3a95', '8fd6b7ce-c640-438b-8779-41abcaf063f9', '54ced996-d790-4cf0-94af-974b5e630e57'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:27 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:09:27 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:28 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:28 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:09:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Deleted volume successfully. Jul 29 16:09:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-02483382-b7cf-4ff6-8fea-8d80363c8842 tempest-SnapshotMetadataTestJSON-1173884282 None] Lock "cinder-c917691f-ba81-409e-ba0c-2a6a3c9911ba-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Flow 'volume_create_manager' (c90b47ac-0821-4c66-8a43-28d4a763d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675f4ba0-64a7-499a-9ff1-e0e3eb89fb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675f4ba0-64a7-499a-9ff1-e0e3eb89fb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1551004954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da1e9a4-12ca-4036-9d52-f1580a0883fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f54053cd2e40dbbf3cccec460f1246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:34Z,use_quota=True,user_id='91c4412cd2c94fc4b9dbb134a05453ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9743b0-8363-4606-bfb0-e79fa58b852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9743b0-8363-4606-bfb0-e79fa58b852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f359141a-d30d-423d-9129-c9e041256f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f359141a-d30d-423d-9129-c9e041256f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da1e9a4-12ca-4036-9d52-f1580a0883fd', 'volume_name': 'volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84e7b68-cdcc-4438-9306-ea682cc52ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84e7b68-cdcc-4438-9306-ea682cc52ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330698b8-9698-4d06-9258-528478786849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Volume 2da1e9a4-12ca-4036-9d52-f1580a0883fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd', 'volume_size': 1} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1551004954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da1e9a4-12ca-4036-9d52-f1580a0883fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f54053cd2e40dbbf3cccec460f1246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:34Z,use_quota=True,user_id='91c4412cd2c94fc4b9dbb134a05453ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Creating volume 2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:33 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:34 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd 1073741824 Jul 29 16:09:34 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:34 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd 1073741824" returned: 0 in 0.717s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:34 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:09:34 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:35 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.465s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330698b8-9698-4d06-9258-528478786849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9613c9af-1b6c-4819-8ae6-69cd16aac72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:35 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Volume volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd (2da1e9a4-12ca-4036-9d52-f1580a0883fd): created successfully Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9613c9af-1b6c-4819-8ae6-69cd16aac72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Flow 'volume_create_manager' (c90b47ac-0821-4c66-8a43-28d4a763d485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fc91d2f9-dee6-4137-b398-36c8934716af tempest-VolumesActionsTest-2107644224 None] Created volume successfully. Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:36 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:09:36 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:37 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.650s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Flow 'volume_create_manager' (4b184128-29d0-4f6b-b222-80358d39e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bda9220-1e3c-4aa0-80d3-96920fa30656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bda9220-1e3c-4aa0-80d3-96920fa30656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-685077871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec42577-a362-4780-9f6f-b70d10a1ee67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6515978827440039638b2e9ae2f7d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:40Z,use_quota=True,user_id='c8d55d8dfeb74adcb63cba613a3e33c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65f5720-0691-45d2-96c1-6e5c4b46e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65f5720-0691-45d2-96c1-6e5c4b46e644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de47e4-f162-485c-9c27-d6708d69b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de47e4-f162-485c-9c27-d6708d69b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec42577-a362-4780-9f6f-b70d10a1ee67', 'volume_name': 'volume-1ec42577-a362-4780-9f6f-b70d10a1ee67', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e0b37b-df74-48da-a20f-510563650365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e0b37b-df74-48da-a20f-510563650365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98b0e0b-209e-4133-9778-c99cfe5573a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Volume 1ec42577-a362-4780-9f6f-b70d10a1ee67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec42577-a362-4780-9f6f-b70d10a1ee67', 'volume_size': 1} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-685077871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec42577-a362-4780-9f6f-b70d10a1ee67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6515978827440039638b2e9ae2f7d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:40Z,use_quota=True,user_id='c8d55d8dfeb74adcb63cba613a3e33c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Creating volume 1ec42577-a362-4780-9f6f-b70d10a1ee67 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:40 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:40 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 1073741824 Jul 29 16:09:40 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:41 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 1073741824" returned: 0 in 0.997s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:41 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 Jul 29 16:09:41 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:41 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67" returned: 0 in 0.400s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98b0e0b-209e-4133-9778-c99cfe5573a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec42577-a362-4780-9f6f-b70d10a1ee67', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a38f0d-78e8-475e-8e28-9db68dd0dcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Volume volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 (1ec42577-a362-4780-9f6f-b70d10a1ee67): created successfully Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a38f0d-78e8-475e-8e28-9db68dd0dcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Flow 'volume_create_manager' (4b184128-29d0-4f6b-b222-80358d39e43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0ca81cee-97c8-453d-bdd3-e6e6d3b3938d tempest-AbsoluteLimitsTests-2016527655 None] Created volume successfully. Jul 29 16:09:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Acquiring lock "cinder-1ec42577-a362-4780-9f6f-b70d10a1ee67-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Lock "cinder-1ec42577-a362-4780-9f6f-b70d10a1ee67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Acquiring lock "cinder-quobyte-1ec42577-a362-4780-9f6f-b70d10a1ee67" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Lock "cinder-quobyte-1ec42577-a362-4780-9f6f-b70d10a1ee67" acquired by "delete_volume" :: waited 0.039s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca0058d-28aa-4387-836c-acce6b77f0c5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:09:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:42 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 Jul 29 16:09:42 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:43 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67" returned: 0 in 0.507s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:43 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67 Jul 29 16:09:43 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:43 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1ec42577-a362-4780-9f6f-b70d10a1ee67" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Lock "cinder-quobyte-1ec42577-a362-4780-9f6f-b70d10a1ee67" released by "delete_volume" :: held 0.862s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Created reservations ['382bc68c-a865-494b-8d3d-dbada0dc2ad4', 'f5a638e0-aa25-4f54-94f5-68fa7f6ea3ca', '5b89664b-67d0-4dff-840c-ae8b81f35b55', '0dd08e53-5f02-4bc3-8c37-b7f978403217'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:43 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:09:43 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:44 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.743s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:09:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Deleted volume successfully. Jul 29 16:09:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9ad4d62f-ee35-4402-a05a-1ab16f65767b tempest-AbsoluteLimitsTests-2016527655 None] Lock "cinder-1ec42577-a362-4780-9f6f-b70d10a1ee67-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8ce42006-641e-47ba-9551-d87bb6cf99da tempest-VolumesActionsTest-2107644224 None] Acquiring lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd" by "attach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8ce42006-641e-47ba-9551-d87bb6cf99da tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd" acquired by "attach_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8ce42006-641e-47ba-9551-d87bb6cf99da tempest-VolumesActionsTest-2107644224 None] Attaching volume 2da1e9a4-12ca-4036-9d52-f1580a0883fd to instance 302641a6-681f-4a40-9fd1-9cd318551a36 at mountpoint /dev/vdb on host None. Jul 29 16:09:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8ce42006-641e-47ba-9551-d87bb6cf99da tempest-VolumesActionsTest-2107644224 None] Attach volume completed successfully. Jul 29 16:09:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8ce42006-641e-47ba-9551-d87bb6cf99da tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd" released by "attach_volume" :: held 0.263s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-37cd38fe-0881-4f7d-802e-f64f6d6d6649 tempest-VolumesActionsTest-2107644224 None] Acquiring lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-detach_volume" by "detach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:09:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-37cd38fe-0881-4f7d-802e-f64f6d6d6649 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:09:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-37cd38fe-0881-4f7d-802e-f64f6d6d6649 tempest-VolumesActionsTest-2107644224 None] Detaching volume 2da1e9a4-12ca-4036-9d52-f1580a0883fd from instance 302641a6-681f-4a40-9fd1-9cd318551a36. Jul 29 16:09:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-37cd38fe-0881-4f7d-802e-f64f6d6d6649 tempest-VolumesActionsTest-2107644224 None] Detach volume completed successfully. Jul 29 16:09:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-37cd38fe-0881-4f7d-802e-f64f6d6d6649 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Flow 'volume_create_manager' (3b5a5107-e794-4402-a66b-f6fb309aa9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f962aaa6-d617-454e-aec3-95eba855ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f962aaa6-d617-454e-aec3-95eba855ea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-169058203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf68c2b6-6346-4f95-ba85-b51d0d02b84b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37447856703c42a6adfe544638db5fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:51Z,use_quota=True,user_id='46cdca8c6aaf4e2aa47d9eecabe61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df83685-f102-445e-80e2-d39424cced4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df83685-f102-445e-80e2-d39424cced4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61adbfe-cb6a-436e-96c0-56d34dfefeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61adbfe-cb6a-436e-96c0-56d34dfefeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf68c2b6-6346-4f95-ba85-b51d0d02b84b', 'volume_name': 'volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae705db-647b-4045-8a65-381d093a41db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae705db-647b-4045-8a65-381d093a41db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c06fd7-fb49-4034-8bfd-2b9e0349fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:51 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Volume bf68c2b6-6346-4f95-ba85-b51d0d02b84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b', 'volume_size': 1} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-169058203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf68c2b6-6346-4f95-ba85-b51d0d02b84b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37447856703c42a6adfe544638db5fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:51Z,use_quota=True,user_id='46cdca8c6aaf4e2aa47d9eecabe61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Creating volume bf68c2b6-6346-4f95-ba85-b51d0d02b84b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:51 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:51 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b 1073741824 Jul 29 16:09:51 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:52 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b 1073741824" returned: 0 in 0.536s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:52 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b Jul 29 16:09:52 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:52 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b" returned: 0 in 0.322s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c06fd7-fb49-4034-8bfd-2b9e0349fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdbf911-de29-44fe-825c-45d7cedd4aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:52 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Volume volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b (bf68c2b6-6346-4f95-ba85-b51d0d02b84b): created successfully Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdbf911-de29-44fe-825c-45d7cedd4aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Flow 'volume_create_manager' (3b5a5107-e794-4402-a66b-f6fb309aa9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9bad9d27-9298-4b69-a0cc-75b437f042fb tempest-VolumesListTestJSON-656836856 None] Created volume successfully. Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Flow 'volume_create_manager' (b37ec9ee-fa53-4e25-b301-a08364dcdd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b63a97-20bb-4698-9c1a-bbbb25f59dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b63a97-20bb-4698-9c1a-bbbb25f59dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1159630661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17f729c-864e-4de7-a9b1-aad7f3bb200d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37447856703c42a6adfe544638db5fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:54Z,use_quota=True,user_id='46cdca8c6aaf4e2aa47d9eecabe61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdab7ca-f81f-461e-bebe-f87c933824e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdab7ca-f81f-461e-bebe-f87c933824e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f070631-eb97-49ee-95d7-2ddddb9c66b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f070631-eb97-49ee-95d7-2ddddb9c66b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17f729c-864e-4de7-a9b1-aad7f3bb200d', 'volume_name': 'volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05432424-7691-4cec-9df9-d4463531ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05432424-7691-4cec-9df9-d4463531ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53571109-b6f2-442d-bdbc-ed591c5427f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Volume f17f729c-864e-4de7-a9b1-aad7f3bb200d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d', 'volume_size': 1} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1159630661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17f729c-864e-4de7-a9b1-aad7f3bb200d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37447856703c42a6adfe544638db5fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:54Z,use_quota=True,user_id='46cdca8c6aaf4e2aa47d9eecabe61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Creating volume f17f729c-864e-4de7-a9b1-aad7f3bb200d {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:54 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:54 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d 1073741824 Jul 29 16:09:54 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:54 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d 1073741824" returned: 0 in 0.462s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:54 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d Jul 29 16:09:54 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:54 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53571109-b6f2-442d-bdbc-ed591c5427f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8810ec46-316f-4c26-a3a8-ef44be22ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Volume volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d (f17f729c-864e-4de7-a9b1-aad7f3bb200d): created successfully Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8810ec46-316f-4c26-a3a8-ef44be22ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Flow 'volume_create_manager' (b37ec9ee-fa53-4e25-b301-a08364dcdd98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:55 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-adac53cb-8fba-402c-a733-68a3f65b206d tempest-VolumesListTestJSON-656836856 None] Created volume successfully. Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Flow 'volume_create_manager' (d3b6ccbd-2d3d-4cce-840f-a9810ee72c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77f9b18-c8ff-4fab-9f6f-34864885f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77f9b18-c8ff-4fab-9f6f-34864885f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-85126080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381e11b0-5a31-4866-bf46-3dc2b982b757,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37447856703c42a6adfe544638db5fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:57Z,use_quota=True,user_id='46cdca8c6aaf4e2aa47d9eecabe61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea8eb21-f714-4a49-97e8-73f0b19f7c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea8eb21-f714-4a49-97e8-73f0b19f7c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cb50a0-151e-4668-9905-698b821d5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cb50a0-151e-4668-9905-698b821d5022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381e11b0-5a31-4866-bf46-3dc2b982b757', 'volume_name': 'volume-381e11b0-5a31-4866-bf46-3dc2b982b757', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8dbb3a-18a2-4225-a130-f11ed4150a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8dbb3a-18a2-4225-a130-f11ed4150a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be69bf8-22da-4cb7-8660-81cb32a51d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:56 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Volume 381e11b0-5a31-4866-bf46-3dc2b982b757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381e11b0-5a31-4866-bf46-3dc2b982b757', 'volume_size': 1} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-85126080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381e11b0-5a31-4866-bf46-3dc2b982b757,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37447856703c42a6adfe544638db5fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:09:57Z,use_quota=True,user_id='46cdca8c6aaf4e2aa47d9eecabe61e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Creating volume 381e11b0-5a31-4866-bf46-3dc2b982b757 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:09:56 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:09:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:57 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 1073741824 Jul 29 16:09:57 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:57 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 1073741824" returned: 0 in 0.528s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:09:57 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 Jul 29 16:09:57 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:09:57 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be69bf8-22da-4cb7-8660-81cb32a51d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381e11b0-5a31-4866-bf46-3dc2b982b757', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54aae711-c693-4c92-b17c-225a0c643035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:09:57 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Volume volume-381e11b0-5a31-4866-bf46-3dc2b982b757 (381e11b0-5a31-4866-bf46-3dc2b982b757): created successfully Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54aae711-c693-4c92-b17c-225a0c643035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:09:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Flow 'volume_create_manager' (d3b6ccbd-2d3d-4cce-840f-a9810ee72c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:09:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d72b7459-6a9d-4bfa-8d74-f17c18c517ff tempest-VolumesListTestJSON-656836856 None] Created volume successfully. Jul 29 16:10:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Acquiring lock "cinder-381e11b0-5a31-4866-bf46-3dc2b982b757-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-381e11b0-5a31-4866-bf46-3dc2b982b757-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Acquiring lock "cinder-quobyte-381e11b0-5a31-4866-bf46-3dc2b982b757" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-quobyte-381e11b0-5a31-4866-bf46-3dc2b982b757" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:01 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b872ab51-8e0c-4197-bb79-956150743472]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:02 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 Jul 29 16:10:02 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:02 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757" returned: 0 in 0.663s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:02 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757 Jul 29 16:10:02 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01582e18-d103-4d5f-910a-9e2eea6c7f6c tempest-VolumesActionsTest-2107644224 None] Acquiring lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd" by "attach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01582e18-d103-4d5f-910a-9e2eea6c7f6c tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd" acquired by "attach_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-01582e18-d103-4d5f-910a-9e2eea6c7f6c tempest-VolumesActionsTest-2107644224 None] Attaching volume 2da1e9a4-12ca-4036-9d52-f1580a0883fd to instance 9ea2e522-fd83-4e3e-8c16-562fda614c3b at mountpoint /dev/vdb on host None. Jul 29 16:10:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-01582e18-d103-4d5f-910a-9e2eea6c7f6c tempest-VolumesActionsTest-2107644224 None] Attach volume completed successfully. Jul 29 16:10:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01582e18-d103-4d5f-910a-9e2eea6c7f6c tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd" released by "attach_volume" :: held 0.182s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:02 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-381e11b0-5a31-4866-bf46-3dc2b982b757" returned: 0 in 0.432s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-quobyte-381e11b0-5a31-4866-bf46-3dc2b982b757" released by "delete_volume" :: held 1.168s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Created reservations ['8873e254-0a80-48fc-8cac-533a8780ad2f', '1ba8293b-cf55-4059-8fdf-749f6bc562e8', 'f74ae7f0-bf13-4ede-8c71-dbfdcc4b6531', 'd2e8c3f1-3600-400b-bffc-4df7a523a748'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-e82f4082-7ae8-429b-8221-463736ff6999 req-bc330e87-0574-4c11-adee-6cc03f28416d tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-e82f4082-7ae8-429b-8221-463736ff6999 req-bc330e87-0574-4c11-adee-6cc03f28416d tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-e82f4082-7ae8-429b-8221-463736ff6999 req-bc330e87-0574-4c11-adee-6cc03f28416d tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-e82f4082-7ae8-429b-8221-463736ff6999 req-bc330e87-0574-4c11-adee-6cc03f28416d tempest-TestServerVolumeAttachmentScenario-833121845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fef66033-5720-49a9-bcfb-70f156073b51', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:10:03 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:03 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-e82f4082-7ae8-429b-8221-463736ff6999 req-bc330e87-0574-4c11-adee-6cc03f28416d tempest-TestServerVolumeAttachmentScenario-833121845 None] attachment_update completed successfully. Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78b98d91-416e-42c8-a59f-29a31cb24897 tempest-VolumesActionsTest-2107644224 None] Acquiring lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-detach_volume" by "detach_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78b98d91-416e-42c8-a59f-29a31cb24897 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-78b98d91-416e-42c8-a59f-29a31cb24897 tempest-VolumesActionsTest-2107644224 None] Detaching volume 2da1e9a4-12ca-4036-9d52-f1580a0883fd from instance 9ea2e522-fd83-4e3e-8c16-562fda614c3b. Jul 29 16:10:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-78b98d91-416e-42c8-a59f-29a31cb24897 tempest-VolumesActionsTest-2107644224 None] Detach volume completed successfully. Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78b98d91-416e-42c8-a59f-29a31cb24897 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:03 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.444s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Deleted volume successfully. Jul 29 16:10:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e2716062-a5c6-4b40-8a87-41675166a2f0 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-381e11b0-5a31-4866-bf46-3dc2b982b757-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Acquiring lock "cinder-f17f729c-864e-4de7-a9b1-aad7f3bb200d-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Lock "cinder-f17f729c-864e-4de7-a9b1-aad7f3bb200d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Acquiring lock "cinder-quobyte-f17f729c-864e-4de7-a9b1-aad7f3bb200d" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Lock "cinder-quobyte-f17f729c-864e-4de7-a9b1-aad7f3bb200d" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[576b6c78-e21d-486d-ac4e-81509f28a0d4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:04 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d Jul 29 16:10:04 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:04 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d" returned: 0 in 0.700s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:05 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d Jul 29 16:10:05 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:05 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f17f729c-864e-4de7-a9b1-aad7f3bb200d" returned: 0 in 0.354s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Lock "cinder-quobyte-f17f729c-864e-4de7-a9b1-aad7f3bb200d" released by "delete_volume" :: held 1.102s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Created reservations ['e26f8467-a615-4ee9-a587-3b24e8756fb1', 'fd99407a-77bb-4bf0-900d-2c8ca1b4af49', '09922d35-361a-48bc-86f3-dbca77cd4477', '84dab6e6-9f0b-4b5f-bb57-83c5db291474'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:05 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:05 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:05 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Deleted volume successfully. Jul 29 16:10:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cdb24160-3f8d-4982-a1fc-303964d4b5da tempest-VolumesListTestJSON-656836856 None] Lock "cinder-f17f729c-864e-4de7-a9b1-aad7f3bb200d-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Acquiring lock "cinder-bf68c2b6-6346-4f95-ba85-b51d0d02b84b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-bf68c2b6-6346-4f95-ba85-b51d0d02b84b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Acquiring lock "cinder-quobyte-bf68c2b6-6346-4f95-ba85-b51d0d02b84b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-quobyte-bf68c2b6-6346-4f95-ba85-b51d0d02b84b" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0a15f-de0a-48b6-816b-1d3f952b0bad]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:06 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b Jul 29 16:10:06 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:07 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b" returned: 0 in 0.474s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:07 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b Jul 29 16:10:07 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:07 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bf68c2b6-6346-4f95-ba85-b51d0d02b84b" returned: 0 in 0.294s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-quobyte-bf68c2b6-6346-4f95-ba85-b51d0d02b84b" released by "delete_volume" :: held 0.849s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Created reservations ['f58986b9-4bc1-4126-8697-df172131b950', '7fc9d3e2-4e72-4302-a2d7-bb2552fb69b3', 'a3b7a3c6-4406-418b-a083-f387ebbe77c7', '79077e52-808f-4d10-bf3f-891389e9f976'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:07 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:07 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:08 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Deleted volume successfully. Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ede79326-6d95-4967-9d22-051997a40df9 tempest-VolumesListTestJSON-656836856 None] Lock "cinder-bf68c2b6-6346-4f95-ba85-b51d0d02b84b-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ed364-5c04-4156-8f53-b57841d57f56]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:08 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:08 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-84489285-f5d5-4c26-a6b6-bcc9887c3606 req-196132a4-a504-43da-9d6f-d4ffbcff63cb tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:09 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[23684b4b-453e-4369-8de2-ac092dcde341]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:09 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:09 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:09 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.395s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.52bf37c9-0b1e-47fb-95f1-fb0392ac85927jex9zop.img {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:09 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.52bf37c9-0b1e-47fb-95f1-fb0392ac85927jex9zop.img Jul 29 16:10:09 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:14 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.52bf37c9-0b1e-47fb-95f1-fb0392ac85927jex9zop.img" returned: 0 in 4.986s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef748f1a-6200-46d6-ba78-f76f1af88300]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:14 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:14 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:15 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.533s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:15 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.52bf37c9-0b1e-47fb-95f1-fb0392ac85927jex9zop.img {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:10:15 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Converted 1024.00 MB image at 205.28 MB/s Jul 29 16:10:15 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=65,cinder:UPDATE=80,cinder:INSERT=20,cinder:DELETE=6 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:10:15 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=80,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=17 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:10:15 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] 52bf37c9-0b1e-47fb-95f1-fb0392ac8592 was raw, no need to convert to raw {{(pid=88575) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (10b9c9d9-d1e4-41af-8705-e7207c08fa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650c3ad6-0570-48dc-ba86-c1f5cda3b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650c3ad6-0570-48dc-ba86-c1f5cda3b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-360581213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1030b54f-2506-4c08-b924-627a4b0a3644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:10:24Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75b92e9-b0b5-4cb9-aeb3-c11503e35072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75b92e9-b0b5-4cb9-aeb3-c11503e35072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c81b83-6726-4e5d-93af-e089546d82c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c81b83-6726-4e5d-93af-e089546d82c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1030b54f-2506-4c08-b924-627a4b0a3644', 'volume_name': 'volume-1030b54f-2506-4c08-b924-627a4b0a3644', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef18e89c-6314-4234-bb26-f7f78131a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef18e89c-6314-4234-bb26-f7f78131a117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46f7eac-9a67-4680-9060-eb7af02b6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Volume 1030b54f-2506-4c08-b924-627a4b0a3644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1030b54f-2506-4c08-b924-627a4b0a3644', 'volume_size': 1} Jul 29 16:10:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:10:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=2 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.836s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Uploaded volume to glance image-id: 52bf37c9-0b1e-47fb-95f1-fb0392ac8592. {{(pid=88575) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-84489285-f5d5-4c26-a6b6-bcc9887c3606 req-196132a4-a504-43da-9d6f-d4ffbcff63cb tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 26.557s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-84489285-f5d5-4c26-a6b6-bcc9887c3606 req-196132a4-a504-43da-9d6f-d4ffbcff63cb tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.340s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-360581213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1030b54f-2506-4c08-b924-627a4b0a3644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:10:24Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Creating volume 1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:10:35 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4578955c-5783-4a23-9f9a-80ea852dc69b tempest-VolumesActionsTest-2107644224 None] Copy volume to image completed successfully. Jul 29 16:10:35 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 1073741824 Jul 29 16:10:35 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-84489285-f5d5-4c26-a6b6-bcc9887c3606 req-196132a4-a504-43da-9d6f-d4ffbcff63cb tempest-TestServerVolumeAttachmentScenario-833121845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-8617ad2d-1863-497e-872d-542e26376a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1354ff83-c574-4da7-91d4-7eab576352bc', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:10:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-84489285-f5d5-4c26-a6b6-bcc9887c3606 req-196132a4-a504-43da-9d6f-d4ffbcff63cb tempest-TestServerVolumeAttachmentScenario-833121845 None] attachment_update completed successfully. Jul 29 16:10:36 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 1073741824" returned: 0 in 0.602s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:36 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 Jul 29 16:10:36 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:36 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46f7eac-9a67-4680-9060-eb7af02b6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1030b54f-2506-4c08-b924-627a4b0a3644', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431eb2d7-aa50-4998-9a33-9626bfe7a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:36 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Volume volume-1030b54f-2506-4c08-b924-627a4b0a3644 (1030b54f-2506-4c08-b924-627a4b0a3644): created successfully Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431eb2d7-aa50-4998-9a33-9626bfe7a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (10b9c9d9-d1e4-41af-8705-e7207c08fa77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ad642048-7d8e-4a97-b65a-30303d82a79a tempest-VolumesSnapshotTestJSON-726051074 None] Created volume successfully. Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:36 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:36 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:37 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.313s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d669d108-2273-41c6-9bc5-c30320937a4e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:37 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:37 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:37 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.502s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[893615b9-c31f-4027-8e13-aac315ad1a03]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:37 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:37 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:38 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.492s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:38 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img Jul 29 16:10:38 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-19ad6b98-5618-4d28-9992-57002cda1bcb req-a90f9ef4-b995-4f25-a178-ccb817f83a5a tempest-TestServerVolumeAttachmentScenario-833121845 None] Terminate volume connection completed successfully. Jul 29 16:10:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-19ad6b98-5618-4d28-9992-57002cda1bcb req-a90f9ef4-b995-4f25-a178-ccb817f83a5a tempest-TestServerVolumeAttachmentScenario-833121845 None] Deleting attachment 1354ff83-c574-4da7-91d4-7eab576352bc. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:10:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-859e1727-0b50-4e24-9299-88de606b39bf req-6e78a50b-c9c3-4f50-9dc8-92ab7b98143e tempest-TestServerVolumeAttachmentScenario-833121845 None] Terminate volume connection completed successfully. Jul 29 16:10:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-859e1727-0b50-4e24-9299-88de606b39bf req-6e78a50b-c9c3-4f50-9dc8-92ab7b98143e tempest-TestServerVolumeAttachmentScenario-833121845 None] Deleting attachment fef66033-5720-49a9-bcfb-70f156073b51. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:10:43 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img" returned: 0 in 5.291s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f784dc1-e957-467e-9ad2-684bd8290d43]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:43 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:43 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:44 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.727s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:10:44 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Converted 1024.00 MB image at 193.49 MB/s Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] 42142ccc-6d2e-48f9-9281-16a72d54d848 was raw, converting to qcow2 {{(pid=88575) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa74f1a-949e-4afc-90a6-d5c06a34aadc]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:44 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img Jul 29 16:10:44 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:44 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img" returned: 0 in 0.355s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:44 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img Jul 29 16:10:44 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:44 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img" returned: 1 in 0.348s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:45 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk Jul 29 16:10:45 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:45 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Image conversion details: src /opt/stack/data/cinder/conversion/2da1e9a4-12ca-4036-9d52-f1580a0883fd.temp_image.42142ccc-6d2e-48f9-9281-16a72d54d848_s_00gye.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:10:45 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96c361-e7bd-41a2-8cb3-4cef7da7643a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:45 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk Jul 29 16:10:45 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:45 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3o09r8kk" returned: 0 in 0.411s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "cinder-8617ad2d-1863-497e-872d-542e26376a05-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-8617ad2d-1863-497e-872d-542e26376a05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "cinder-quobyte-8617ad2d-1863-497e-872d-542e26376a05" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-quobyte-8617ad2d-1863-497e-872d-542e26376a05" acquired by "delete_volume" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814f2c6-30e4-4def-97f4-a4d9286ffb6b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:47 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 Jul 29 16:10:47 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.292s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Uploaded volume to glance image-id: 42142ccc-6d2e-48f9-9281-16a72d54d848. {{(pid=88575) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.926s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Creating offline snapshot dacdee2f-7774-4297-bdc2-29fdc2115e03 of volume 1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:10:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d83672e0-ba3b-4bcc-8131-c2f9e324e099 tempest-VolumesActionsTest-2107644224 None] Copy volume to image completed successfully. Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d8005d-1bcc-4276-9d5e-76441c193c6d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:47 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05" returned: 0 in 0.426s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:47 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05 Jul 29 16:10:47 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:47 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 Jul 29 16:10:47 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:47 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8617ad2d-1863-497e-872d-542e26376a05" returned: 0 in 0.301s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:47 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-quobyte-8617ad2d-1863-497e-872d-542e26376a05" released by "delete_volume" :: held 0.781s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644" returned: 0 in 0.435s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:47 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 1G Jul 29 16:10:47 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Created reservations ['63aeee6b-f6fe-46b5-853b-ed9e0386573b', 'ed914632-76cb-4496-b6d9-7a064e9dbc04', '2855ff1a-e09e-4b73-b0b7-90b6df8b5be5', '3014762b-d338-4304-b078-40dd30bd9bcc'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:48 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:48 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "cinder-e419e581-b65a-46fb-a9f0-fd14fa68a69b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-e419e581-b65a-46fb-a9f0-fd14fa68a69b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "cinder-quobyte-e419e581-b65a-46fb-a9f0-fd14fa68a69b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-quobyte-e419e581-b65a-46fb-a9f0-fd14fa68a69b" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:48 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.343s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a5cab-62d5-49a0-ba00-806d31bd0f4e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Deleted volume successfully. Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-85f1a130-efdd-442a-bd3e-145a6ac72ea1 tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-8617ad2d-1863-497e-872d-542e26376a05-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:48 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 1G" returned: 0 in 0.605s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1030b54f-2506-4c08-b924-627a4b0a3644 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:48 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1030b54f-2506-4c08-b924-627a4b0a3644 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 Jul 29 16:10:48 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Acquiring lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:48 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b Jul 29 16:10:48 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Acquiring lock "cinder-quobyte-2da1e9a4-12ca-4036-9d52-f1580a0883fd" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-quobyte-2da1e9a4-12ca-4036-9d52-f1580a0883fd" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aeb03f-5591-411a-aa56-eccdc3436390]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:48 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:48 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:48 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b" returned: 0 in 0.468s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:48 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:48 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b Jul 29 16:10:48 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1030b54f-2506-4c08-b924-627a4b0a3644 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:48 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 is being set with open permissions: ugo+rw Jul 29 16:10:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:48 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 Jul 29 16:10:48 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:49 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:49 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd Jul 29 16:10:49 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:49 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e419e581-b65a-46fb-a9f0-fd14fa68a69b" returned: 0 in 0.307s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-quobyte-e419e581-b65a-46fb-a9f0-fd14fa68a69b" released by "delete_volume" :: held 0.840s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:49 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info Jul 29 16:10:49 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Created reservations ['17456033-70b0-422d-8e06-b50a1203b7cd', '5511873e-7f33-434f-96d7-4669d7d1f16b', 'de427a46-d443-430b-af2f-6e90def54eee', 'b8548823-7762-42d0-b6e2-54f8d58535bb'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:49 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2da1e9a4-12ca-4036-9d52-f1580a0883fd" returned: 0 in 0.303s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:49 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-quobyte-2da1e9a4-12ca-4036-9d52-f1580a0883fd" released by "delete_volume" :: held 0.776s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Created reservations ['1cd97988-9894-4e4a-ab59-7dfd3c61b5ee', '9e1d7e5b-9f10-4c4b-ab18-059b79d8c6b7', 'd4c44faa-3e64-4540-a24d-57a6b53d4cd8', '1fdd8c4c-72f0-42e2-a40b-11e680c71038'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:49 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info" returned: 0 in 0.410s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info is being set with open permissions: ugo+rw Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:49 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:10:49 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:49 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info Jul 29 16:10:49 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:49 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Deleted volume successfully. Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-895a764e-19a0-4a83-bafa-60c3a79b834c tempest-TestServerVolumeAttachmentScenario-833121845 None] Lock "cinder-e419e581-b65a-46fb-a9f0-fd14fa68a69b-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:49 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.318s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:49 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:10:49 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Deleted volume successfully. Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.info" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80439a74-8eb0-44cd-9754-2eb920da5c66 tempest-VolumesActionsTest-2107644224 None] Lock "cinder-2da1e9a4-12ca-4036-9d52-f1580a0883fd-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5f5eb5de-e719-4bac-b3ef-b3e44efb60d4 tempest-VolumesSnapshotTestJSON-726051074 None] Create snapshot completed successfully Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-dacdee2f-7774-4297-bdc2-29fdc2115e03-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-dacdee2f-7774-4297-bdc2-29fdc2115e03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-1030b54f-2506-4c08-b924-627a4b0a3644" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-1030b54f-2506-4c08-b924-627a4b0a3644" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-dacdee2f-7774-4297-bdc2-29fdc2115e03" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-dacdee2f-7774-4297-bdc2-29fdc2115e03" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Deleting offline snapshot dacdee2f-7774-4297-bdc2-29fdc2115e03 of volume 1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] snapshot_file for this snap is: volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5b7413-0bb3-4df1-a55d-81343321d245]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:50 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 Jul 29 16:10:50 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:51 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03" returned: 0 in 0.460s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1030b54f-2506-4c08-b924-627a4b0a3644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:10:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ddd052-671a-4994-939c-26b66feda424]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:51 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 Jul 29 16:10:51 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:51 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:51 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 Jul 29 16:10:51 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:52 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03" returned: 0 in 0.379s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:52 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03 Jul 29 16:10:52 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:52 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644.dacdee2f-7774-4297-bdc2-29fdc2115e03" returned: 0 in 0.309s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-dacdee2f-7774-4297-bdc2-29fdc2115e03" released by "_delete_snapshot" :: held 1.761s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-1030b54f-2506-4c08-b924-627a4b0a3644" released by "delete_snapshot" :: held 1.788s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['461de7fb-559d-47c6-bdc4-abadfec395ab', 'd9463b80-cabe-4e03-a138-c58959ff26f8', '0e04272f-42d7-4fc5-a29c-303afe9c4d06', '83045253-5de9-44be-84f9-a848b6ca267d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:10:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Delete snapshot completed successfully. Jul 29 16:10:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-19cfb7e8-f6af-4109-97be-a75559b3eded tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-dacdee2f-7774-4297-bdc2-29fdc2115e03-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (c4a912bd-1b58-4aaa-8e6a-6cd0706600fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff0cbfb-9de6-4f07-bbaa-54ce31532c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff0cbfb-9de6-4f07-bbaa-54ce31532c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-504827311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773d935f-d0aa-4a7c-9aef-fc227396ea9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:10:53Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173e54b-b4ae-4686-87b4-04fbade55ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173e54b-b4ae-4686-87b4-04fbade55ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf84657-814a-4ff1-8a3e-7a01ad349182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf84657-814a-4ff1-8a3e-7a01ad349182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773d935f-d0aa-4a7c-9aef-fc227396ea9d', 'volume_name': 'volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d84b6e7-1b31-4a81-ac39-1e8c764d597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d84b6e7-1b31-4a81-ac39-1e8c764d597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b921565d-53e4-40b3-9e48-1327aa081d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:53 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Volume 773d935f-d0aa-4a7c-9aef-fc227396ea9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d', 'volume_size': 1} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-504827311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773d935f-d0aa-4a7c-9aef-fc227396ea9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:10:53Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Creating volume 773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:10:53 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:10:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:53 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d 1073741824 Jul 29 16:10:53 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:54 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d 1073741824" returned: 0 in 0.649s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:54 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:10:54 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:54 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 0.297s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b921565d-53e4-40b3-9e48-1327aa081d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae9e9d1-09bc-491d-98f2-36afca22dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Volume volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d (773d935f-d0aa-4a7c-9aef-fc227396ea9d): created successfully Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae9e9d1-09bc-491d-98f2-36afca22dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (c4a912bd-1b58-4aaa-8e6a-6cd0706600fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d3e51068-721f-4c58-bf95-8d3ee5be1f66 tempest-VolumesSnapshotTestJSON-726051074 None] Created volume successfully. Jul 29 16:10:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Creating offline snapshot 7b5ca689-d89d-4b12-9309-c30acb727e54 of volume 773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:10:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[419edf7a-9e94-48bd-896d-d0501b6b97de]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:56 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:10:56 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:56 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 0.447s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:56 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 1G Jul 29 16:10:56 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:56 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 1G" returned: 0 in 0.502s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:56 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 Jul 29 16:10:56 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:57 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:57 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 is being set with open permissions: ugo+rw Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:57 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 Jul 29 16:10:57 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Flow 'volume_create_manager' (0f876368-67af-4b48-ae92-e623b064d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e71465b-d148-4c79-8ea8-69b45395fd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e71465b-d148-4c79-8ea8-69b45395fd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1129288832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c87af0d-0e64-4f95-8d22-ddc293284a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1812281491399a328df957ca154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:10:57Z,use_quota=True,user_id='87cb4fe395a54341a1230c22fee5a5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e65ae1-dca4-49c9-9926-f2221402664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e65ae1-dca4-49c9-9926-f2221402664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8eb2d8-4601-466f-b513-846267e5c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8eb2d8-4601-466f-b513-846267e5c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c87af0d-0e64-4f95-8d22-ddc293284a08', 'volume_name': 'volume-4c87af0d-0e64-4f95-8d22-ddc293284a08', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d53a43-b27b-4c8a-bff0-300a90c3ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d53a43-b27b-4c8a-bff0-300a90c3ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45233361-d4e4-47c8-aa33-9fd18d55c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:57 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Volume 4c87af0d-0e64-4f95-8d22-ddc293284a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c87af0d-0e64-4f95-8d22-ddc293284a08', 'volume_size': 1} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:57 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:57 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info Jul 29 16:10:57 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:57 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info" returned: 0 in 0.387s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:57 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info is being set with open permissions: ugo+rw Jul 29 16:10:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:58 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info Jul 29 16:10:58 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:58 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.info" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1129288832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c87af0d-0e64-4f95-8d22-ddc293284a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1812281491399a328df957ca154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:10:57Z,use_quota=True,user_id='87cb4fe395a54341a1230c22fee5a5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Creating volume 4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:10:58 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:58 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 1073741824 Jul 29 16:10:58 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:58 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-37d3483e-71f1-4091-a41e-752862cf0ca4 tempest-VolumesSnapshotTestJSON-726051074 None] Create snapshot completed successfully Jul 29 16:10:58 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 1073741824" returned: 0 in 0.581s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:58 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:10:58 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:10:59 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.327s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45233361-d4e4-47c8-aa33-9fd18d55c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c87af0d-0e64-4f95-8d22-ddc293284a08', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448d28c1-3322-4a0c-9042-1d7f9b37a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:59 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Volume volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 (4c87af0d-0e64-4f95-8d22-ddc293284a08): created successfully Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448d28c1-3322-4a0c-9042-1d7f9b37a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Flow 'volume_create_manager' (0f876368-67af-4b48-ae92-e623b064d511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:59 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-172b1103-fe64-4cf0-bd1a-435affac2120 tempest-VolumesCloneTest-1939731418 None] Created volume successfully. Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (c517cc03-e85c-45de-b3f8-ad0f687bb8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d8d759-e54c-4d57-b0ca-d96f2a9b0bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d8d759-e54c-4d57-b0ca-d96f2a9b0bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1865189547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a03e37-0e61-48f8-b30b-1fdc92dad3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7b5ca689-d89d-4b12-9309-c30acb727e54,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:00Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469028ee-e896-46d5-ac0f-6edcd1c09289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469028ee-e896-46d5-ac0f-6edcd1c09289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fc315c-356e-46e5-a413-e55bc189316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fc315c-356e-46e5-a413-e55bc189316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8a03e37-0e61-48f8-b30b-1fdc92dad3b0', 'volume_name': 'volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0', 'volume_size': 2, 'snapshot_id': '7b5ca689-d89d-4b12-9309-c30acb727e54'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6992634-a794-4529-bff4-653caad2b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6992634-a794-4529-bff4-653caad2b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8e0486-1894-407b-b9e1-3d9fa570ea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:10:59 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Volume d8a03e37-0e61-48f8-b30b-1fdc92dad3b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0', 'volume_size': 2, 'snapshot_id': '7b5ca689-d89d-4b12-9309-c30acb727e54'} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-7b5ca689-d89d-4b12-9309-c30acb727e54-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7b5ca689-d89d-4b12-9309-c30acb727e54-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Creating volume d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 from snapshot 7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] snapshot: 7b5ca689-d89d-4b12-9309-c30acb727e54, volume: d8a03e37-0e61-48f8-b30b-1fdc92dad3b0, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[450abaee-78b6-401a-b803-53f2fb3fa5ca]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:10:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:10:59 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 Jul 29 16:10:59 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:00 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54" returned: 0 in 0.416s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f85f6-11fc-40ac-94ea-5adb3fd9e433]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:00 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:11:00 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:00 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 0.440s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:11:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:00 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 Jul 29 16:11:00 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Flow 'volume_create_manager' (d90f93d1-535f-4d4f-a1a6-9b94bafc06c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd5f4d8-3d10-40ae-9115-4c59f84b99e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd5f4d8-3d10-40ae-9115-4c59f84b99e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-850171734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0866010-5e25-47cf-bf51-d60f8520237b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1812281491399a328df957ca154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4c87af0d-0e64-4f95-8d22-ddc293284a08,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:01Z,use_quota=True,user_id='87cb4fe395a54341a1230c22fee5a5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad9abbf-0618-47f6-9bde-85a7c823276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad9abbf-0618-47f6-9bde-85a7c823276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c7b24c-9749-4d56-a8c1-3df3854395e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c7b24c-9749-4d56-a8c1-3df3854395e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f0866010-5e25-47cf-bf51-d60f8520237b', 'volume_name': 'volume-f0866010-5e25-47cf-bf51-d60f8520237b', 'volume_size': 2, 'source_volid': '4c87af0d-0e64-4f95-8d22-ddc293284a08', 'source_volstatus': 'available'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92f4ad9-ba4f-488c-876b-d458ec083176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92f4ad9-ba4f-488c-876b-d458ec083176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cca3a3-95c1-4482-a16c-de5a167704fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Volume f0866010-5e25-47cf-bf51-d60f8520237b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f0866010-5e25-47cf-bf51-d60f8520237b', 'volume_size': 2, 'source_volid': '4c87af0d-0e64-4f95-8d22-ddc293284a08', 'source_volstatus': 'available'} Jul 29 16:11:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:06 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" returned: 0 in 5.780s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcec51a-8b6f-4c21-ae82-e0ecdb1d0574]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:06 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:11:06 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:07 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 0.656s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:11:07 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Converted 1024.00 MB image at 177.12 MB/s Jul 29 16:11:07 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 is being set with open permissions: ugo+rw Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:07 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 Jul 29 16:11:07 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-6ce57e95-7b88-4ecd-96ba-579dace0d7f4 req-fc31aaf5-6a0f-4247-baf4-7b4056d535fb tempest-ServerActionsTestOtherA-375942156 None] Terminate volume connection completed successfully. Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-6ce57e95-7b88-4ecd-96ba-579dace0d7f4 req-fc31aaf5-6a0f-4247-baf4-7b4056d535fb tempest-ServerActionsTestOtherA-375942156 None] Deleting attachment 93c01327-3596-4af1-b5be-43b3089164cb. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:11:07 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" returned: 0 in 0.377s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" released by "_copy_volume_from_snapshot" :: held 7.777s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7b5ca689-d89d-4b12-9309-c30acb727e54-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" released by "_create_volume_from_snapshot" :: held 7.814s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.831s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.306s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:07 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Cloning volume 4c87af0d-0e64-4f95-8d22-ddc293284a08 to volume f0866010-5e25-47cf-bf51-d60f8520237b Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Creating offline snapshot 669f4690-567f-49ac-b3e9-f373d90166ac of volume 4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8e0486-1894-407b-b9e1-3d9fa570ea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0', 'volume_size': 2, 'snapshot_id': '7b5ca689-d89d-4b12-9309-c30acb727e54'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de80c895-74cc-4e8a-8af7-c88b063b60c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd47d32-ae58-4185-a1e8-091d4910170b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Volume volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 (d8a03e37-0e61-48f8-b30b-1fdc92dad3b0): created successfully Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de80c895-74cc-4e8a-8af7-c88b063b60c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (c517cc03-e85c-45de-b3f8-ad0f687bb8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-eabf03ae-57bd-4aae-a006-e5f82afb32fe tempest-VolumesSnapshotTestJSON-726051074 None] Created volume successfully. Jul 29 16:11:07 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:11:07 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:08 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.548s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:08 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac 1G Jul 29 16:11:08 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "cinder-107787c2-8381-4445-b0e8-931b11aac4a1-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Lock "cinder-107787c2-8381-4445-b0e8-931b11aac4a1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:08 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac 1G" returned: 0 in 0.684s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "cinder-quobyte-107787c2-8381-4445-b0e8-931b11aac4a1" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:08 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac Jul 29 16:11:08 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Lock "cinder-quobyte-107787c2-8381-4445-b0e8-931b11aac4a1" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28f1da-4413-41ea-abbe-a37c5988407e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" acquired by "delete_volume" :: waited 0.041s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb30fcb-ed76-4388-b8a1-7b2b54ed8daa]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:09 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 Jul 29 16:11:09 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:09 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 Jul 29 16:11:09 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:09 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac" returned: 0 in 0.454s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:09 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac is being set with open permissions: ugo+rw Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:09 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac Jul 29 16:11:09 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:09 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:09 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1 Jul 29 16:11:09 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:09 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" returned: 0 in 0.470s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:09 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0 Jul 29 16:11:09 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:09 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac" returned: 0 in 0.305s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:09 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info Jul 29 16:11:09 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:09 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-107787c2-8381-4445-b0e8-931b11aac4a1" returned: 0 in 0.345s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Lock "cinder-quobyte-107787c2-8381-4445-b0e8-931b11aac4a1" released by "delete_volume" :: held 0.905s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:09 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" returned: 0 in 0.323s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0" released by "delete_volume" :: held 0.873s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:09 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Created reservations ['25a42dfe-f3a7-4107-a5f1-187a9624ce74', 'c5b30116-d187-4815-a1f8-c5f0705840d5', 'd6851097-fc69-41c4-b135-24412075cf29', '34d6668b-2447-4eca-b48e-79f6d48b17f2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['a8bd57b6-e94c-424f-af41-8acbf913d82e', '8ec6b74e-1dce-4cf4-baed-b1c95ab9fb15', '00b6758e-7f07-41b8-b179-0b17eeeea446', 'b07db00b-d742-42ce-b4e7-782c8b842ab1'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:10 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:10 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info is being set with open permissions: ugo+rw Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:10 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info Jul 29 16:11:10 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:10 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:10 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:10 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:10 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:10 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.info" returned: 0 in 0.316s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Acquiring lock "cinder-quobyte-f0866010-5e25-47cf-bf51-d60f8520237b" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:10 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.308s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-f0866010-5e25-47cf-bf51-d60f8520237b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] snapshot: 669f4690-567f-49ac-b3e9-f373d90166ac, volume: f0866010-5e25-47cf-bf51-d60f8520237b, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Deleted volume successfully. Jul 29 16:11:10 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dace6a-c9fc-4f8a-ae5c-01918cfb29ba]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e7a92297-c642-4041-9820-9cc40c6ec4f4 tempest-ServerActionsTestOtherA-375942156 None] Lock "cinder-107787c2-8381-4445-b0e8-931b11aac4a1-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Deleted volume successfully. Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ae8296ec-0b30-4f88-80c0-912e7911802f tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-d8a03e37-0e61-48f8-b30b-1fdc92dad3b0-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:10 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac Jul 29 16:11:10 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:10 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c87af0d-0e64-4f95-8d22-ddc293284a08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:11:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[20838992-755f-4620-a1e6-149f8380fb51]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:11 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:11:11 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-7b5ca689-d89d-4b12-9309-c30acb727e54-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-7b5ca689-d89d-4b12-9309-c30acb727e54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-773d935f-d0aa-4a7c-9aef-fc227396ea9d" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-773d935f-d0aa-4a7c-9aef-fc227396ea9d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-7b5ca689-d89d-4b12-9309-c30acb727e54" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7b5ca689-d89d-4b12-9309-c30acb727e54" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Deleting offline snapshot 7b5ca689-d89d-4b12-9309-c30acb727e54 of volume 773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] snapshot_file for this snap is: volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f531176-789f-493d-bb30-2c7ae07178d0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:11 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.611s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:11:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:11 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b Jul 29 16:11:11 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:11 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 Jul 29 16:11:11 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:12 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54" returned: 0 in 0.751s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56d8467-8895-48d9-a09c-4789ac0c17d0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:12 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:11:12 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:13 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 0.855s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:13 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 Jul 29 16:11:13 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:14 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54" returned: 0 in 1.149s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:14 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54 Jul 29 16:11:14 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:15 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d.7b5ca689-d89d-4b12-9309-c30acb727e54" returned: 0 in 0.842s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7b5ca689-d89d-4b12-9309-c30acb727e54" released by "_delete_snapshot" :: held 3.812s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-773d935f-d0aa-4a7c-9aef-fc227396ea9d" released by "delete_snapshot" :: held 3.882s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:15 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['6bf12cc8-4d80-416e-b9cb-4c0f92f8370e', '54081f7d-79d6-4824-8bf5-ee73f0304966', 'dc745456-1042-4854-bb40-eb9da835371d', 'fdc5ac09-98c1-47e6-9952-16aa9c544899'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Delete snapshot completed successfully. Jul 29 16:11:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d80efd6-6a85-4584-bdd2-d7c9c60ebfcc tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-7b5ca689-d89d-4b12-9309-c30acb727e54-delete_snapshot" released by "delete_snapshot" :: held 4.385s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-773d935f-d0aa-4a7c-9aef-fc227396ea9d-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-773d935f-d0aa-4a7c-9aef-fc227396ea9d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-773d935f-d0aa-4a7c-9aef-fc227396ea9d" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-773d935f-d0aa-4a7c-9aef-fc227396ea9d" acquired by "delete_volume" :: waited 0.041s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:16 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52637bf-fa62-49ba-8957-49f2883e5d8c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:17 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:11:17 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:17 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 0.816s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:17 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d Jul 29 16:11:17 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:18 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-773d935f-d0aa-4a7c-9aef-fc227396ea9d" returned: 0 in 1.041s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-773d935f-d0aa-4a7c-9aef-fc227396ea9d" released by "delete_volume" :: held 2.055s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:18 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b" returned: 0 in 7.029s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c8ccb-2d03-46ef-bb39-bdc5e65f8ff1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['d23964e7-51b2-4e9d-8d60-09ae171c9ca3', '54410fff-d5b3-4303-8dad-02e35ae5db74', '821f8f76-48d6-4025-9753-91d9d2819fb9', '94893510-3184-4357-8589-b52a4c3b10c9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:18 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:11:18 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:18 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:18 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:19 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Deleted volume successfully. Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59dea02a-3ffc-454b-98b4-66e594aeacd0 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-773d935f-d0aa-4a7c-9aef-fc227396ea9d-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:19 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.789s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:11:19 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Converted 1024.00 MB image at 145.66 MB/s Jul 29 16:11:19 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b is being set with open permissions: ugo+rw Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:19 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b Jul 29 16:11:19 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:19 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b" returned: 0 in 0.292s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-f0866010-5e25-47cf-bf51-d60f8520237b" released by "_copy_volume_from_snapshot" :: held 9.260s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Acquiring lock "cinder-quobyte-669f4690-567f-49ac-b3e9-f373d90166ac" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-669f4690-567f-49ac-b3e9-f373d90166ac" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Deleting offline snapshot 669f4690-567f-49ac-b3e9-f373d90166ac of volume 4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] snapshot_file for this snap is: volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb7c6ea-9368-4dda-9353-6fde8fea0d97]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:20 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac Jul 29 16:11:20 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:20 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac" returned: 0 in 0.501s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c87af0d-0e64-4f95-8d22-ddc293284a08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39224a5-fca7-499d-baa0-7d4ea773d7ff]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:20 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:11:20 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (6069b382-9474-40dd-80bd-52bff86d267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32cba00-6fda-4f3d-b381-5593d15575bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32cba00-6fda-4f3d-b381-5593d15575bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-827298918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7baeec71-920a-487a-96a1-1f54644432bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:21Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264266d9-fc36-4b32-bca5-2792eea4f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264266d9-fc36-4b32-bca5-2792eea4f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95cd9db-a0e2-45f3-843c-7195cdfbe896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95cd9db-a0e2-45f3-843c-7195cdfbe896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7baeec71-920a-487a-96a1-1f54644432bb', 'volume_name': 'volume-7baeec71-920a-487a-96a1-1f54644432bb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c07b8b-c452-4c96-9fad-343a996d500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c07b8b-c452-4c96-9fad-343a996d500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd72a0a-3986-4655-8953-1b409851f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:20 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Volume 7baeec71-920a-487a-96a1-1f54644432bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7baeec71-920a-487a-96a1-1f54644432bb', 'volume_size': 1} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:20 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.525s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:20 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac Jul 29 16:11:20 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:21 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac" returned: 0 in 0.418s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:21 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac Jul 29 16:11:21 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:21 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08.669f4690-567f-49ac-b3e9-f373d90166ac" returned: 0 in 0.283s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-669f4690-567f-49ac-b3e9-f373d90166ac" released by "_delete_snapshot" :: held 1.906s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.192s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.961s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-827298918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7baeec71-920a-487a-96a1-1f54644432bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:21Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Creating volume 7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:11:21 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cca3a3-95c1-4482-a16c-de5a167704fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0866010-5e25-47cf-bf51-d60f8520237b', 'volume_size': 2, 'source_volid': '4c87af0d-0e64-4f95-8d22-ddc293284a08', 'source_volstatus': 'available'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f8f4f7-a0cf-48a8-97fb-b589695800b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:21 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb 1073741824 Jul 29 16:11:21 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Volume volume-f0866010-5e25-47cf-bf51-d60f8520237b (f0866010-5e25-47cf-bf51-d60f8520237b): created successfully Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f8f4f7-a0cf-48a8-97fb-b589695800b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Flow 'volume_create_manager' (d90f93d1-535f-4d4f-a1a6-9b94bafc06c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-04f5a600-bf50-40a9-be89-bfc54a48b650 tempest-VolumesCloneTest-1939731418 None] Created volume successfully. Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Acquiring lock "cinder-f0866010-5e25-47cf-bf51-d60f8520237b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Lock "cinder-f0866010-5e25-47cf-bf51-d60f8520237b-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Acquiring lock "cinder-quobyte-f0866010-5e25-47cf-bf51-d60f8520237b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-f0866010-5e25-47cf-bf51-d60f8520237b" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[558e8af1-6258-4ca8-9342-5364ff7a09de]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:22 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb 1073741824" returned: 0 in 0.667s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:22 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:22 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:22 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b Jul 29 16:11:22 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:22 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd72a0a-3986-4655-8953-1b409851f622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7baeec71-920a-487a-96a1-1f54644432bb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ffb010-6b7a-4fd6-a00c-d4627b504bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Volume volume-7baeec71-920a-487a-96a1-1f54644432bb (7baeec71-920a-487a-96a1-1f54644432bb): created successfully Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ffb010-6b7a-4fd6-a00c-d4627b504bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (6069b382-9474-40dd-80bd-52bff86d267f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0418fa9e-a138-4477-b317-fe8c7be68dd8 tempest-VolumesSnapshotTestJSON-726051074 None] Created volume successfully. Jul 29 16:11:22 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b" returned: 0 in 0.548s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:23 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b Jul 29 16:11:23 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:23 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0866010-5e25-47cf-bf51-d60f8520237b" returned: 0 in 0.321s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-f0866010-5e25-47cf-bf51-d60f8520237b" released by "delete_volume" :: held 0.935s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Created reservations ['02eec76a-5a63-4861-b271-2efb8e1d6e30', '68ce154c-3c9c-4097-b4a1-2b3fe495ce32', '02eb7924-fbd2-4d7f-a06f-ba6e3e3e92e0', 'f4a9bbe6-6254-4460-b321-ae04147347b2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:23 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:23 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:23 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.292s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Deleted volume successfully. Jul 29 16:11:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e9d90576-77b7-4e8a-b6be-fbb4d86ae89a tempest-VolumesCloneTest-1939731418 None] Lock "cinder-f0866010-5e25-47cf-bf51-d60f8520237b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Creating offline snapshot affac2ed-cdd7-4366-b723-5d62da411db8 of volume 7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a72642-eca0-4743-bcf9-23970db47f3d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:24 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:24 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:24 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Acquiring lock "cinder-4c87af0d-0e64-4f95-8d22-ddc293284a08-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.476s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Lock "cinder-4c87af0d-0e64-4f95-8d22-ddc293284a08-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:24 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 1G Jul 29 16:11:24 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Acquiring lock "cinder-quobyte-4c87af0d-0e64-4f95-8d22-ddc293284a08" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-4c87af0d-0e64-4f95-8d22-ddc293284a08" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b6e51-b98b-4b48-925d-21e6088ce1ad]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:25 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:11:25 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:25 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 1G" returned: 0 in 0.662s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7baeec71-920a-487a-96a1-1f54644432bb -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:25 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7baeec71-920a-487a-96a1-1f54644432bb -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 Jul 29 16:11:25 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:25 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.542s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:25 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08 Jul 29 16:11:25 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:25 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7baeec71-920a-487a-96a1-1f54644432bb -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8" returned: 0 in 0.415s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:25 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 is being set with open permissions: ugo+rw Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:25 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 Jul 29 16:11:25 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:25 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4c87af0d-0e64-4f95-8d22-ddc293284a08" returned: 0 in 0.409s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Lock "cinder-quobyte-4c87af0d-0e64-4f95-8d22-ddc293284a08" released by "delete_volume" :: held 1.089s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Created reservations ['7da91cb3-9ae4-473c-935b-868a2e7590fd', '1621601f-4a7b-493d-bd31-05d959f7fc9f', '7541dd43-84e3-46c3-a788-6107aff4e2cc', '9b39740d-72bd-4aa1-8520-bda86b89a8ac'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:26 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:26 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:26 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8" returned: 0 in 0.469s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:26 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info Jul 29 16:11:26 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:26 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.378s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Deleted volume successfully. Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-afe584f6-277f-4814-9659-42d1cb28622d tempest-VolumesCloneTest-1939731418 None] Lock "cinder-4c87af0d-0e64-4f95-8d22-ddc293284a08-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:26 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info" returned: 0 in 0.387s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:26 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info is being set with open permissions: ugo+rw Jul 29 16:11:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:26 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info Jul 29 16:11:26 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:27 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.info" returned: 0 in 0.402s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:27 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0ecf4637-da23-4b5b-a76d-1a15302cc352 tempest-VolumesSnapshotTestJSON-726051074 None] Create snapshot completed successfully Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (7cd86750-4f19-4a5f-bb7f-ae1d8ee60412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baaeef88-e1bf-4d54-bb2f-2d0043492724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baaeef88-e1bf-4d54-bb2f-2d0043492724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2134863950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804dd9b6-14ca-45f0-8820-bba28d1cfcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fec250914c4b91932a5362b84d1b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=affac2ed-cdd7-4366-b723-5d62da411db8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:28Z,use_quota=True,user_id='5c3b155ec1ec4673a439d4007f5f72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c77c342-8684-40df-b066-081128b52711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c77c342-8684-40df-b066-081128b52711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f11a26e-79b4-4b80-b1a8-7b9cde7d58c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f11a26e-79b4-4b80-b1a8-7b9cde7d58c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '804dd9b6-14ca-45f0-8820-bba28d1cfcb8', 'volume_name': 'volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8', 'volume_size': 1, 'snapshot_id': 'affac2ed-cdd7-4366-b723-5d62da411db8'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e980cd1-04d6-45d1-a389-215127004e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e980cd1-04d6-45d1-a389-215127004e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d2ad12-6882-46c2-b0a5-0b9114472b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:28 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Volume 804dd9b6-14ca-45f0-8820-bba28d1cfcb8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8', 'volume_size': 1, 'snapshot_id': 'affac2ed-cdd7-4366-b723-5d62da411db8'} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-affac2ed-cdd7-4366-b723-5d62da411db8-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-affac2ed-cdd7-4366-b723-5d62da411db8-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Creating volume 804dd9b6-14ca-45f0-8820-bba28d1cfcb8 from snapshot affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] snapshot: affac2ed-cdd7-4366-b723-5d62da411db8, volume: 804dd9b6-14ca-45f0-8820-bba28d1cfcb8, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[be985855-c1fb-4b97-b699-021bba353da4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:28 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 Jul 29 16:11:28 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:28 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8" returned: 0 in 0.492s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7baeec71-920a-487a-96a1-1f54644432bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3993d7-c41d-4635-98ef-7bff02ec55d4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:29 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:29 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:29 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.527s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:29 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:11:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:29 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 Jul 29 16:11:29 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Flow 'volume_create_manager' (7ae0ddbf-bbd1-4caa-bf60-ce07ba0435c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962090a7-9779-4e46-821e-753434a24283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962090a7-9779-4e46-821e-753434a24283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1066759447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46969b95-f760-4708-9295-b712a6024147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa355570ac46a89aa2badc48510ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:34Z,use_quota=True,user_id='02181a51a8534f4f8de6ccac9e95a128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb07a3b5-16a7-46c8-9f25-f37ec9da88a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb07a3b5-16a7-46c8-9f25-f37ec9da88a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ec7c36-cb84-4796-a062-1e3ea75789b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:33 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:11:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ec7c36-cb84-4796-a062-1e3ea75789b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46969b95-f760-4708-9295-b712a6024147', 'volume_name': 'volume-46969b95-f760-4708-9295-b712a6024147', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081d344-d01a-4937-8699-56f5cbeb3bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081d344-d01a-4937-8699-56f5cbeb3bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53975971-863c-4851-ba61-4a03159b62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:34 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Volume 46969b95-f760-4708-9295-b712a6024147: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46969b95-f760-4708-9295-b712a6024147', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 29 16:11:34 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Trying to clone 46969b95-f760-4708-9295-b712a6024147 from image 16778ff0-340b-4c4a-846b-47774617fa95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:11:35 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD, size 20.69 MB, duration 1.05 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:11:35 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Image download 20.69 MB at 19.72 MB/s Jul 29 16:11:35 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[033fa171-96aa-4c5a-bad7-2c2291f5ea9d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:36 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" returned: 0 in 6.763s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f3bf80-77e5-4c16-9676-f358aaa2e582]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:36 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD Jul 29 16:11:36 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:36 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:36 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:36 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 is fetched for user 02181a51a8534f4f8de6ccac9e95a128. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=107,cinder:UPDATE=105,cinder:INSERT=23,cinder:DELETE=6 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=87,cinder:UPDATE=98,cinder:DELETE=11,cinder:INSERT=27 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[861eb8a8-ca2f-4e66-941d-1132bc1b6347]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:36 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD Jul 29 16:11:36 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:36 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:36 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:37 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.329s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:37 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.923s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:11:37 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Converted 1024.00 MB image at 151.29 MB/s Jul 29 16:11:37 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 is being set with open permissions: ugo+rw Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:37 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:37 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 Jul 29 16:11:37 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:37 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" returned: 0 in 0.299s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" released by "_copy_volume_from_snapshot" :: held 9.145s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-affac2ed-cdd7-4366-b723-5d62da411db8-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" released by "_create_volume_from_snapshot" :: held 9.196s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.217s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1066759447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46969b95-f760-4708-9295-b712a6024147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa355570ac46a89aa2badc48510ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:34Z,use_quota=True,user_id='02181a51a8534f4f8de6ccac9e95a128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Creating volume 46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:11:37 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:37 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 1073741824 Jul 29 16:11:37 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d2ad12-6882-46c2-b0a5-0b9114472b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8', 'volume_size': 1, 'snapshot_id': 'affac2ed-cdd7-4366-b723-5d62da411db8'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9234459f-0a04-4b48-81a6-955803709af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Volume volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 (804dd9b6-14ca-45f0-8820-bba28d1cfcb8): created successfully Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9234459f-0a04-4b48-81a6-955803709af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Flow 'volume_create_manager' (7cd86750-4f19-4a5f-bb7f-ae1d8ee60412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1451b36f-f2ee-410a-ad4a-125ba7a210d8 tempest-VolumesSnapshotTestJSON-726051074 None] Created volume successfully. Jul 29 16:11:38 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 1073741824" returned: 0 in 0.666s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:38 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 Jul 29 16:11:38 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:38 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-804dd9b6-14ca-45f0-8820-bba28d1cfcb8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-804dd9b6-14ca-45f0-8820-bba28d1cfcb8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Attempting download of 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume 46969b95-f760-4708-9295-b712a6024147. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31efd43-5169-401e-8fda-9ca7a43f7a43]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[15729fd4-7956-475a-b350-719d5dd4b85a]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:38 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940 Jul 29 16:11:38 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:38 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 Jul 29 16:11:38 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:39 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940" returned: 0 in 0.422s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:39 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" returned: 0 in 0.495s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:39 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8 Jul 29 16:11:39 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:39 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940 Jul 29 16:11:39 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:39 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940" returned: 1 in 0.482s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_583c_940' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf42aa6a-cce1-4706-b2e7-bc3672666960]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:39 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" returned: 0 in 0.438s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-804dd9b6-14ca-45f0-8820-bba28d1cfcb8" released by "delete_volume" :: held 0.987s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['24ea1768-b0c1-4d4b-b595-6469c410a958', '88a1a052-b5f9-430d-945c-d008a78c51c1', '3b53b401-b7bf-408e-b2cb-37fd2265ee32', 'fe8e5129-ad87-4b7d-b07d-02c70b7ce2b7'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:39 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD Jul 29 16:11:39 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:39 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:39 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:40 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] 16778ff0-340b-4c4a-846b-47774617fa95 was qcow2, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:40 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 Jul 29 16:11:40 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:40 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.471s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Deleted volume successfully. Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a11c6492-9b88-467e-8687-6c080d65f990 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-804dd9b6-14ca-45f0-8820-bba28d1cfcb8-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-affac2ed-cdd7-4366-b723-5d62da411db8-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-affac2ed-cdd7-4366-b723-5d62da411db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-7baeec71-920a-487a-96a1-1f54644432bb" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7baeec71-920a-487a-96a1-1f54644432bb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-affac2ed-cdd7-4366-b723-5d62da411db8" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-affac2ed-cdd7-4366-b723-5d62da411db8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Deleting offline snapshot affac2ed-cdd7-4366-b723-5d62da411db8 of volume 7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] snapshot_file for this snap is: volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68c4e66-f2d1-46c4-b3f8-1a360e72015c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:41 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 Jul 29 16:11:41 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:41 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8" returned: 0 in 0.548s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7baeec71-920a-487a-96a1-1f54644432bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3b11a-a353-4102-8068-d116c967ad47]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:41 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:41 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:42 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.559s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:42 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 Jul 29 16:11:42 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:42 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8" returned: 0 in 0.491s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:42 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8 Jul 29 16:11:42 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:42 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147" returned: 0 in 2.619s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_1xiy1dsidevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:11:42 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Converted 112.00 MB image at 42.72 MB/s Jul 29 16:11:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:42 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 1G Jul 29 16:11:42 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:43 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb.affac2ed-cdd7-4366-b723-5d62da411db8" returned: 0 in 0.423s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-affac2ed-cdd7-4366-b723-5d62da411db8" released by "_delete_snapshot" :: held 2.168s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7baeec71-920a-487a-96a1-1f54644432bb" released by "delete_snapshot" :: held 2.204s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['c09c6d9b-031e-4eb4-9c83-79a9db043d4a', '27d093d4-8489-47fa-9c8d-3a7398e4c3ac', 'f916e577-46f8-476f-b701-7e8185ad4cb6', 'fe67d7ad-ddb4-42c4-b886-5c83a5fb784c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:43 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 1G" returned: 0 in 0.514s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Downloaded image 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume 46969b95-f760-4708-9295-b712a6024147 successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 for user 02181a51a8534f4f8de6ccac9e95a128 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Marking volume 46969b95-f760-4708-9295-b712a6024147 as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Copying metadata from image 16778ff0-340b-4c4a-846b-47774617fa95 to 46969b95-f760-4708-9295-b712a6024147. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Creating volume glance metadata for volume 46969b95-f760-4708-9295-b712a6024147 backed by image 16778ff0-340b-4c4a-846b-47774617fa95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:11:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Delete snapshot completed successfully. Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-994fd8ec-11f2-419c-9cc0-262b749d6b44 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-affac2ed-cdd7-4366-b723-5d62da411db8-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53975971-863c-4851-ba61-4a03159b62ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46969b95-f760-4708-9295-b712a6024147', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b197cac4-8402-4478-855d-4f9dc53a62a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:43 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Volume volume-46969b95-f760-4708-9295-b712a6024147 (46969b95-f760-4708-9295-b712a6024147): created successfully Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b197cac4-8402-4478-855d-4f9dc53a62a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Flow 'volume_create_manager' (7ae0ddbf-bbd1-4caa-bf60-ce07ba0435c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2608eeee-cd2c-464a-9f17-7d0668b8495a tempest-VolumesExtendTest-1518270531 None] Created volume successfully. Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-7baeec71-920a-487a-96a1-1f54644432bb-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-7baeec71-920a-487a-96a1-1f54644432bb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-7baeec71-920a-487a-96a1-1f54644432bb" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7baeec71-920a-487a-96a1-1f54644432bb" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd26861-bded-4403-b1f9-97a731324f6d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:44 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:44 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e6290-bcbe-4d0d-b432-9d5a4f244320]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:45 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 Jul 29 16:11:45 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:45 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.607s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:45 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb Jul 29 16:11:45 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:45 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147" returned: 0 in 0.465s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 2G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:45 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7baeec71-920a-487a-96a1-1f54644432bb" returned: 0 in 0.424s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-7baeec71-920a-487a-96a1-1f54644432bb" released by "delete_volume" :: held 1.111s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 2G" returned: 0 in 0.169s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.687s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8bc5713c-a595-4ea4-b904-4741f62a8427 tempest-VolumesExtendTest-1518270531 None] Extend volume completed successfully. Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['0fcdde38-d640-4ac1-895e-2ad033537c47', 'a22015c1-9a4e-431a-b5ec-4a086220252f', '95ab3680-2243-4b27-a577-3e3296eb5839', '3cdd12e7-43cd-4853-bffe-4348f778bf9a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:45 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:45 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:45 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Flow 'volume_create_manager' (82e1c65b-3a5a-468f-a4fc-95b20b9d908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174023db-697d-48fb-a875-4cf25a701ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174023db-697d-48fb-a875-4cf25a701ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1591919899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ea3783-7fae-40a1-a4c4-fbd360e6d59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc59e4d99a0e4239a44ac79bcc65da1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:46Z,use_quota=True,user_id='c9c9414f4e2f457dbf04fb1bffddd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf6d32-935a-412a-bef3-979e99bd5199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf6d32-935a-412a-bef3-979e99bd5199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d82213-3539-4061-94c3-a13eae4657e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:11:46 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Deleted volume successfully. Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e56f6693-0de8-410f-8fbd-c55c7c49e7df tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-7baeec71-920a-487a-96a1-1f54644432bb-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-46969b95-f760-4708-9295-b712a6024147-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-46969b95-f760-4708-9295-b712a6024147-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-quobyte-46969b95-f760-4708-9295-b712a6024147" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-46969b95-f760-4708-9295-b712a6024147" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4d939a-efd9-4408-826d-2a9222c5355d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d82213-3539-4061-94c3-a13eae4657e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59ea3783-7fae-40a1-a4c4-fbd360e6d59b', 'volume_name': 'volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f511bc98-dfda-4ef8-80c6-06531e80aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f511bc98-dfda-4ef8-80c6-06531e80aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeff1a4-35f4-4d5b-82ed-b4d39a71bd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:46 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Volume 59ea3783-7fae-40a1-a4c4-fbd360e6d59b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Trying to clone 59ea3783-7fae-40a1-a4c4-fbd360e6d59b from image 16778ff0-340b-4c4a-846b-47774617fa95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:11:46 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 Jul 29 16:11:46 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-1030b54f-2506-4c08-b924-627a4b0a3644-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-1030b54f-2506-4c08-b924-627a4b0a3644-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:47 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "cinder-quobyte-1030b54f-2506-4c08-b924-627a4b0a3644" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147" returned: 0 in 0.584s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:11:47 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Image download 20.69 MB at 20.69 MB/s Jul 29 16:11:47 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147 Jul 29 16:11:47 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-1030b54f-2506-4c08-b924-627a4b0a3644" acquired by "delete_volume" :: waited 0.046s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81c2b31-db4c-4326-a414-75024c59db1b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cef5d0e-e392-4989-95de-3de991d56842]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:47 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 Jul 29 16:11:47 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:47 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD Jul 29 16:11:47 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:47 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-46969b95-f760-4708-9295-b712a6024147" returned: 0 in 0.324s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-46969b95-f760-4708-9295-b712a6024147" released by "delete_volume" :: held 0.958s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Created reservations ['993bcdf8-e1f5-49e6-8736-cb9ebfa32ae5', 'aa1c59c8-21a2-424c-b5c3-190a49fcc7ee', 'ca727ee6-13e8-45b9-9b38-4a47a1fd71b6', '4d967465-b06d-4728-aae5-75c02d0e5ed1'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:47 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:47 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:47 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 is fetched for user c9c9414f4e2f457dbf04fb1bffddd3c6. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:11:47 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644" returned: 0 in 0.554s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:47 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644 Jul 29 16:11:47 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d311d-20c0-4a31-8c84-15a7d5c8f440]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:47 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Deleted volume successfully. Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-11262ef9-f671-431a-bded-b6e3fb3a4f00 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-46969b95-f760-4708-9295-b712a6024147-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:47 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD Jul 29 16:11:47 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:47 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1030b54f-2506-4c08-b924-627a4b0a3644" returned: 0 in 0.311s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-quobyte-1030b54f-2506-4c08-b924-627a4b0a3644" released by "delete_volume" :: held 0.944s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Created reservations ['2b045b33-548b-4ed8-9aac-a734b31baac4', '91017a4b-db98-4ec1-aa2c-f875ba2a2a4c', '49326d1c-d641-4b65-9c69-718e8920b6a3', 'd1a9bb06-3e6a-44e8-b462-7e9ead80ca3c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:48 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:11:48 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:48 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1591919899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ea3783-7fae-40a1-a4c4-fbd360e6d59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc59e4d99a0e4239a44ac79bcc65da1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:46Z,use_quota=True,user_id='c9c9414f4e2f457dbf04fb1bffddd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Creating volume 59ea3783-7fae-40a1-a4c4-fbd360e6d59b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:11:48 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:48 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b 1073741824 Jul 29 16:11:48 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:48 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.310s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:11:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Deleted volume successfully. Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2da8151a-7630-41ab-87bd-8d982f57ade3 tempest-VolumesSnapshotTestJSON-726051074 None] Lock "cinder-1030b54f-2506-4c08-b924-627a4b0a3644-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:48 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b 1073741824" returned: 0 in 0.635s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:48 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b Jul 29 16:11:48 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Flow 'volume_create_manager' (ef591fc4-63c0-4615-8697-9af4191923a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9227d3-2de2-4d17-8f19-c09c2b5739d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9227d3-2de2-4d17-8f19-c09c2b5739d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1247773094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb60bf0e-efee-45c3-94ad-ec19c54be403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa355570ac46a89aa2badc48510ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:49Z,use_quota=True,user_id='02181a51a8534f4f8de6ccac9e95a128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f4ce87-035d-491b-8d64-c4fae0bc26f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f4ce87-035d-491b-8d64-c4fae0bc26f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53163c7f-560e-4df5-8a49-81338dc61a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53163c7f-560e-4df5-8a49-81338dc61a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb60bf0e-efee-45c3-94ad-ec19c54be403', 'volume_name': 'volume-cb60bf0e-efee-45c3-94ad-ec19c54be403', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e990cad-c11f-44e0-a3a2-6019faf0d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e990cad-c11f-44e0-a3a2-6019faf0d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb73db6-3ee7-45b9-9f3f-0b8d5788507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:49 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:49 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Volume cb60bf0e-efee-45c3-94ad-ec19c54be403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb60bf0e-efee-45c3-94ad-ec19c54be403', 'volume_size': 1} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1247773094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb60bf0e-efee-45c3-94ad-ec19c54be403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa355570ac46a89aa2badc48510ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:49Z,use_quota=True,user_id='02181a51a8534f4f8de6ccac9e95a128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Creating volume cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:11:49 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:49 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 1073741824 Jul 29 16:11:49 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Attempting download of 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume 59ea3783-7fae-40a1-a4c4-fbd360e6d59b. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b258f3b0-83ba-4fb8-af89-3e2878888f67]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:49 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n Jul 29 16:11:49 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:49 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:49 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 1073741824" returned: 0 in 0.594s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:50 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 Jul 29 16:11:50 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:50 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n Jul 29 16:11:50 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:50 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n" returned: 1 in 0.561s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_4so5jl6n' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0e059a-6069-47d0-87b3-4ba00be3dac6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:50 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403" returned: 0 in 0.538s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb73db6-3ee7-45b9-9f3f-0b8d5788507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb60bf0e-efee-45c3-94ad-ec19c54be403', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55abd81-3524-4abf-b716-a247ec559643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Volume volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 (cb60bf0e-efee-45c3-94ad-ec19c54be403): created successfully Jul 29 16:11:50 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD Jul 29 16:11:50 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55abd81-3524-4abf-b716-a247ec559643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Flow 'volume_create_manager' (ef591fc4-63c0-4615-8697-9af4191923a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-21311eac-668a-4936-a880-3f88c40ab426 tempest-VolumesExtendTest-1518270531 None] Created volume successfully. Jul 29 16:11:50 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] 16778ff0-340b-4c4a-846b-47774617fa95 was qcow2, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:11:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:50 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b Jul 29 16:11:50 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Creating offline snapshot 59811156-0130-4cf1-99a6-9365d8607322 of volume cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:11:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb9b8bf-caae-4bec-b89f-5caf9b423929]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:51 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 Jul 29 16:11:51 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:52 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403" returned: 0 in 0.537s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:52 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 1G Jul 29 16:11:52 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:52 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 1G" returned: 0 in 0.693s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:52 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 Jul 29 16:11:52 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:53 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:53 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 is being set with open permissions: ugo+rw Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:53 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 Jul 29 16:11:53 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:53 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" returned: 0 in 2.464s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_tm9t5m5ndevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:11:53 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Converted 112.00 MB image at 45.43 MB/s Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:53 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b 1G Jul 29 16:11:53 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:53 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322" returned: 0 in 0.447s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:53 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info Jul 29 16:11:53 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:53 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b 1G" returned: 0 in 0.474s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Downloaded image 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume 59ea3783-7fae-40a1-a4c4-fbd360e6d59b successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 for user c9c9414f4e2f457dbf04fb1bffddd3c6 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Marking volume 59ea3783-7fae-40a1-a4c4-fbd360e6d59b as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Copying metadata from image 16778ff0-340b-4c4a-846b-47774617fa95 to 59ea3783-7fae-40a1-a4c4-fbd360e6d59b. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:11:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Creating volume glance metadata for volume 59ea3783-7fae-40a1-a4c4-fbd360e6d59b backed by image 16778ff0-340b-4c4a-846b-47774617fa95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeff1a4-35f4-4d5b-82ed-b4d39a71bd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a93152-6934-4434-b85b-2882052339ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Volume volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b (59ea3783-7fae-40a1-a4c4-fbd360e6d59b): created successfully Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a93152-6934-4434-b85b-2882052339ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Flow 'volume_create_manager' (82e1c65b-3a5a-468f-a4fc-95b20b9d908c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-06825ecf-05cd-467f-bc09-3b984cd643c1 tempest-TestShelveInstance-396051194 None] Created volume successfully. Jul 29 16:11:54 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info" returned: 0 in 0.446s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:54 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info is being set with open permissions: ugo+rw Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:54 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info Jul 29 16:11:54 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:54 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.info" returned: 0 in 0.287s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0cf8be66-d874-46e5-aa65-f7d3242891eb tempest-VolumesExtendTest-1518270531 None] Create snapshot completed successfully Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45a5c2b-b07b-484b-a89b-c58a73b46213]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:55 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 Jul 29 16:11:55 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:55 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403" returned: 0 in 0.468s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 2G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 2G" returned: 0 in 0.194s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.719s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:55 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5c84d137-a46d-4855-b837-90ff1ae1914b tempest-VolumesExtendTest-1518270531 None] Extend volume completed successfully. Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-59811156-0130-4cf1-99a6-9365d8607322-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-59811156-0130-4cf1-99a6-9365d8607322-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-quobyte-cb60bf0e-efee-45c3-94ad-ec19c54be403" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-cb60bf0e-efee-45c3-94ad-ec19c54be403" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-quobyte-59811156-0130-4cf1-99a6-9365d8607322" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-59811156-0130-4cf1-99a6-9365d8607322" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Deleting offline snapshot 59811156-0130-4cf1-99a6-9365d8607322 of volume cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] snapshot_file for this snap is: volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fb146-787b-47d4-a02b-2d60db03afb8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:56 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 Jul 29 16:11:56 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:57 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322" returned: 0 in 0.587s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb60bf0e-efee-45c3-94ad-ec19c54be403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:11:57 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[71601ce6-68c1-4b71-9584-be82a2c5d56b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:57 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 Jul 29 16:11:57 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:57 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403" returned: 0 in 0.581s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:57 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 Jul 29 16:11:57 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:58 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322" returned: 0 in 0.582s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:58 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322 Jul 29 16:11:58 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:58 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 29 16:11:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403.59811156-0130-4cf1-99a6-9365d8607322" returned: 0 in 0.536s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:11:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-59811156-0130-4cf1-99a6-9365d8607322" released by "_delete_snapshot" :: held 2.499s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-cb60bf0e-efee-45c3-94ad-ec19c54be403" released by "delete_snapshot" :: held 2.532s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Created reservations ['6f623ec8-4dae-43af-b06a-feb654eba905', 'ca9e9b01-4f1d-451b-a7f1-7464140fa4c7', '37c182ad-95b0-4e68-85d6-bc32c7c30c92', 'd901a1eb-d15b-4d39-a96f-04457520e3ca'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Flow 'volume_create_manager' (85a0a92e-424e-46df-b837-90b1cc84264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615b55a6-8ee5-4479-be8f-70626edfee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:59 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Delete snapshot completed successfully. Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1fffc4c7-dac2-42e0-bcb5-732262f595d0 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-59811156-0130-4cf1-99a6-9365d8607322-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615b55a6-8ee5-4479-be8f-70626edfee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-565660919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c68c7af-86c2-41be-8a1a-df70e5aeaac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d0191bf6f444789ada457fc522378a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:59Z,use_quota=True,user_id='2b29f112ef3742cf8f0c4ded6e501166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a266c11-c681-4785-baf0-e9e20517e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a266c11-c681-4785-baf0-e9e20517e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5044e8b1-e19b-46bf-91ea-39abdc1ba24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5044e8b1-e19b-46bf-91ea-39abdc1ba24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c68c7af-86c2-41be-8a1a-df70e5aeaac2', 'volume_name': 'volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2', 'volume_size': 2}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f97cec-e587-4a7b-a1fc-0144e8fea3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f97cec-e587-4a7b-a1fc-0144e8fea3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467bd863-be47-4da9-b2a6-7d3cb062cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:11:59 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Volume 1c68c7af-86c2-41be-8a1a-df70e5aeaac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2', 'volume_size': 2} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-565660919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c68c7af-86c2-41be-8a1a-df70e5aeaac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d0191bf6f444789ada457fc522378a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:11:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:11:59Z,use_quota=True,user_id='2b29f112ef3742cf8f0c4ded6e501166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Creating volume 1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:11:59 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 2147483648 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:11:59 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 2147483648 Jul 29 16:11:59 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-d8eec58a-827d-4d99-9b7c-d5f5d0d1f848 req-688d63d2-529c-4c7f-bce9-6f6d5ba0ce2d tempest-TestShelveInstance-396051194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-cb60bf0e-efee-45c3-94ad-ec19c54be403-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-cb60bf0e-efee-45c3-94ad-ec19c54be403-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "cinder-quobyte-cb60bf0e-efee-45c3-94ad-ec19c54be403" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-cb60bf0e-efee-45c3-94ad-ec19c54be403" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4674b3d-6a17-43e4-b5f9-d3079d80a022]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:11:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:00 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 Jul 29 16:12:00 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:00 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 2147483648" returned: 0 in 0.729s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:00 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 Jul 29 16:12:00 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:00 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403" returned: 0 in 0.577s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:00 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403 Jul 29 16:12:00 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:00 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" returned: 0 in 0.344s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-d8eec58a-827d-4d99-9b7c-d5f5d0d1f848 req-688d63d2-529c-4c7f-bce9-6f6d5ba0ce2d tempest-TestShelveInstance-396051194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.120s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-d8eec58a-827d-4d99-9b7c-d5f5d0d1f848 req-688d63d2-529c-4c7f-bce9-6f6d5ba0ce2d tempest-TestShelveInstance-396051194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467bd863-be47-4da9-b2a6-7d3cb062cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2', 'volume_size': 2}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfd00ae-92da-444e-ba77-b241a166e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:00 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Volume volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 (1c68c7af-86c2-41be-8a1a-df70e5aeaac2): created successfully Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfd00ae-92da-444e-ba77-b241a166e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Flow 'volume_create_manager' (85a0a92e-424e-46df-b837-90b1cc84264f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:12:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-147a7dd7-c3d4-4100-8ee6-f437f16c63d2 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Created volume successfully. Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-d8eec58a-827d-4d99-9b7c-d5f5d0d1f848 req-688d63d2-529c-4c7f-bce9-6f6d5ba0ce2d tempest-TestShelveInstance-396051194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d989b36-8b13-4913-9882-953d3681ccbd', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:12:00 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb60bf0e-efee-45c3-94ad-ec19c54be403" returned: 0 in 0.382s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-quobyte-cb60bf0e-efee-45c3-94ad-ec19c54be403" released by "delete_volume" :: held 1.065s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-d8eec58a-827d-4d99-9b7c-d5f5d0d1f848 req-688d63d2-529c-4c7f-bce9-6f6d5ba0ce2d tempest-TestShelveInstance-396051194 None] attachment_update completed successfully. Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Created reservations ['9e9ca682-f5af-4034-8e12-28ed8cb8da63', 'c1ae363a-5068-42cf-b1f5-b4d732c41950', '478167e0-e9ed-4927-857f-410d42a68768', '596ed601-40ff-4caf-8f88-5f0959360be2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:01 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:12:01 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:01 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.437s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:12:01 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Deleted volume successfully. Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-62efdec3-def8-406e-83b0-a59c1758e9a8 tempest-VolumesExtendTest-1518270531 None] Lock "cinder-cb60bf0e-efee-45c3-94ad-ec19c54be403-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Creating offline snapshot 87481f4f-dc63-4cac-8253-f61f0bfe3f02 of volume 1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a20a284-c730-4465-9a7e-faf9775aa46d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:01 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 Jul 29 16:12:01 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:02 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" returned: 0 in 0.970s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 2G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:02 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 2G Jul 29 16:12:02 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:03 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 2G" returned: 0 in 0.798s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:03 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 Jul 29 16:12:03 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:04 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02" returned: 0 in 0.733s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:04 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 is being set with open permissions: ugo+rw Jul 29 16:12:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:04 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 Jul 29 16:12:04 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:04 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02" returned: 0 in 0.667s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:04 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info Jul 29 16:12:04 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:05 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info" returned: 0 in 0.537s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:05 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info is being set with open permissions: ugo+rw Jul 29 16:12:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:05 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info Jul 29 16:12:05 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:06 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.info" returned: 0 in 0.592s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b0548030-7eda-461c-88e0-7b725afb49b1 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Create snapshot completed successfully Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "cinder-87481f4f-dc63-4cac-8253-f61f0bfe3f02-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-87481f4f-dc63-4cac-8253-f61f0bfe3f02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "cinder-quobyte-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-quobyte-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "cinder-quobyte-87481f4f-dc63-4cac-8253-f61f0bfe3f02" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-quobyte-87481f4f-dc63-4cac-8253-f61f0bfe3f02" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Deleting offline snapshot 87481f4f-dc63-4cac-8253-f61f0bfe3f02 of volume 1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] snapshot_file for this snap is: volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[62be8eaa-e808-4eb6-b04f-fd0eb151a8dc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:07 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 Jul 29 16:12:07 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:08 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02" returned: 0 in 1.033s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abddbf5-aeeb-41d6-8f01-f4b6f03e84a2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Flow 'volume_create_manager' (aa9775ed-8e33-4d3b-a926-99c3439a69e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121ea7c-73cd-4248-8fc8-3672d8ef3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121ea7c-73cd-4248-8fc8-3672d8ef3762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-784327555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb5219f-3e99-4f68-a5df-c4fad88f286b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37938670ec0646ce9dc554724a47ef3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:12:09Z,use_quota=True,user_id='9bf757e7fba84a6988dbe134515bc03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80ec50b-f823-423d-ad2c-fec0e0f07220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80ec50b-f823-423d-ad2c-fec0e0f07220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:08 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a28a6d-63d4-45ce-aa95-a2ea153c3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:08 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a28a6d-63d4-45ce-aa95-a2ea153c3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb5219f-3e99-4f68-a5df-c4fad88f286b', 'volume_name': 'volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3308aba5-e922-44df-8e3e-fa7a51d70971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3308aba5-e922-44df-8e3e-fa7a51d70971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627142de-b8f8-4ef7-b871-d322dec789c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:08 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b', 'volume_size': 1} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-784327555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb5219f-3e99-4f68-a5df-c4fad88f286b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37938670ec0646ce9dc554724a47ef3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:12:09Z,use_quota=True,user_id='9bf757e7fba84a6988dbe134515bc03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Creating volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:12:08 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:12:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:08 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b 1073741824 Jul 29 16:12:08 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:09 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" returned: 0 in 0.883s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:09 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 Jul 29 16:12:09 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:09 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b 1073741824" returned: 0 in 0.721s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:09 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b Jul 29 16:12:09 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:10 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02" returned: 0 in 0.813s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:10 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02 Jul 29 16:12:10 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:10 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b" returned: 0 in 0.586s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627142de-b8f8-4ef7-b871-d322dec789c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056f1a3c-dfea-48c3-9fa4-790e7a78d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Volume volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b (3fb5219f-3e99-4f68-a5df-c4fad88f286b): created successfully Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056f1a3c-dfea-48c3-9fa4-790e7a78d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Flow 'volume_create_manager' (aa9775ed-8e33-4d3b-a926-99c3439a69e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:12:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f321e254-a66d-42a1-98f7-5d51118828df tempest-VolumesSnapshotListTestJSON-1103397662 None] Created volume successfully. Jul 29 16:12:10 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2.87481f4f-dc63-4cac-8253-f61f0bfe3f02" returned: 0 in 0.738s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-quobyte-87481f4f-dc63-4cac-8253-f61f0bfe3f02" released by "_delete_snapshot" :: held 3.773s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-quobyte-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" released by "delete_snapshot" :: held 3.828s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Created reservations ['404d46b9-ef5f-4d13-87d5-87f0260c2aef', '5bd4e2df-3ae2-4a15-8b78-b3abfb9c0017', '1dd731d8-f7a9-47c5-8e9c-39b7cd756b22', 'f7c92433-a5b2-48c1-b2f8-42ca0c3b6207'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Creating offline snapshot 64b70aa7-afce-432d-9e90-42a8d09f28e3 of volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e7407-f5a9-4b45-835e-d9c58620a495]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Delete snapshot completed successfully. Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-45ff9765-f82d-4120-9ba8-07110d4ddec6 tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-87481f4f-dc63-4cac-8253-f61f0bfe3f02-delete_snapshot" released by "delete_snapshot" :: held 4.321s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:11 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b Jul 29 16:12:11 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "cinder-1c68c7af-86c2-41be-8a1a-df70e5aeaac2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-1c68c7af-86c2-41be-8a1a-df70e5aeaac2-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "cinder-quobyte-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-quobyte-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52bb22f-7c8c-4676-844d-c2ff32a9542f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:12 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 Jul 29 16:12:12 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:12 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b" returned: 0 in 1.198s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:12 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 1G Jul 29 16:12:12 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:12 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" returned: 0 in 0.871s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:12 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2 Jul 29 16:12:12 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:13 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" returned: 0 in 0.598s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-quobyte-1c68c7af-86c2-41be-8a1a-df70e5aeaac2" released by "delete_volume" :: held 1.580s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:13 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 1G" returned: 0 in 0.989s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:13 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:13 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Created reservations ['8477a7dd-88c2-40e2-b1a6-a97f3d00b70b', 'a3085421-f70a-4118-aa4a-9aa6a76037c4', '48f27184-8baa-4310-93fe-2843013fa63c', '05089cda-a017-44cd-9dbe-9e2961821928'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:13 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:12:14 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:14 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:14 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.772s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:14 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 is being set with open permissions: ugo+rw Jul 29 16:12:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:14 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:12:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Deleted volume successfully. Jul 29 16:12:14 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:14 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03d72dc1-4448-4a95-91dd-ff44061c884a tempest-VolumesSnapshotNegativeTestJSON-868614696 None] Lock "cinder-1c68c7af-86c2-41be-8a1a-df70e5aeaac2-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:14 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.624s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:15 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info Jul 29 16:12:15 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:15 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info" returned: 0 in 0.384s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:15 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info is being set with open permissions: ugo+rw Jul 29 16:12:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:15 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info Jul 29 16:12:15 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:15 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.info" returned: 0 in 0.509s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.698s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f7feada3-4571-449c-909c-1fffefb7135d tempest-VolumesSnapshotListTestJSON-1103397662 None] Create snapshot completed successfully Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Creating offline snapshot dd30b6bc-96c3-4645-ae00-2cbc4508f622 of volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a917d16-330e-498d-b2d0-7ab19b3ae6e7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:17 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:17 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:17 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.540s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:17 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 1G Jul 29 16:12:17 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:18 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 1G" returned: 0 in 0.667s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:18 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:18 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:19 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.489s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:19 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 is being set with open permissions: ugo+rw Jul 29 16:12:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:19 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:19 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:19 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.356s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-34761cd5-ec5c-4c0e-861a-18deeb06028f tempest-VolumesSnapshotListTestJSON-1103397662 None] Create snapshot completed successfully Jul 29 16:12:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Creating offline snapshot 27564edc-a93e-485f-80b3-56ac6f62d21d of volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:12:20 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b069c3-1286-4868-a33b-e0effd592d38]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:20 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:20 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:21 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:21 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d 1G Jul 29 16:12:21 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:21 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d 1G" returned: 0 in 0.569s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:21 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d Jul 29 16:12:21 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:22 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:22 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d is being set with open permissions: ugo+rw Jul 29 16:12:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:22 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d Jul 29 16:12:22 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:22 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.688s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-790751da-d5e1-4ae6-bb08-c505aeaaa75a tempest-VolumesSnapshotListTestJSON-1103397662 None] Create snapshot completed successfully Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-27564edc-a93e-485f-80b3-56ac6f62d21d-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-27564edc-a93e-485f-80b3-56ac6f62d21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-27564edc-a93e-485f-80b3-56ac6f62d21d" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-27564edc-a93e-485f-80b3-56ac6f62d21d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Deleting offline snapshot 27564edc-a93e-485f-80b3-56ac6f62d21d of volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] snapshot_file for this snap is: volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c137eaf-282b-45a7-a9b6-7ebcaaeb779c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:24 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d Jul 29 16:12:24 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:24 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d" returned: 0 in 0.632s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1715132-3e24-4a33-b97a-6b1c0e8d4564]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:24 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:24 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:25 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.454s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:25 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d Jul 29 16:12:25 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:25 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d" returned: 0 in 0.499s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:25 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d Jul 29 16:12:25 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:25 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.27564edc-a93e-485f-80b3-56ac6f62d21d" returned: 0 in 0.347s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-27564edc-a93e-485f-80b3-56ac6f62d21d" released by "_delete_snapshot" :: held 2.082s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" released by "delete_snapshot" :: held 2.119s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:26 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Created reservations ['d2f39731-5a67-4363-aa72-701ee9571f07', 'c180bb42-7d05-433e-9260-12d5e929b4f9', 'd2464f6d-32ed-4035-a51f-52703ef444e4', 'e4e13ea7-6841-421c-bfd1-db54573ee6ac'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Delete snapshot completed successfully. Jul 29 16:12:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fc910e78-1703-4ca9-8186-ec7d18d012b1 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-27564edc-a93e-485f-80b3-56ac6f62d21d-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-dd30b6bc-96c3-4645-ae00-2cbc4508f622-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-dd30b6bc-96c3-4645-ae00-2cbc4508f622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-dd30b6bc-96c3-4645-ae00-2cbc4508f622" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-dd30b6bc-96c3-4645-ae00-2cbc4508f622" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Deleting offline snapshot dd30b6bc-96c3-4645-ae00-2cbc4508f622 of volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] snapshot_file for this snap is: volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c8fe8-5d24-45f1-9d3a-5de69b514eed]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:27 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:27 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:27 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.511s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7338ac5-e2ca-43df-b628-db98080117bf]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:28 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:28 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:28 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.439s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:28 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:28 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:28 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.477s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:28 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622 Jul 29 16:12:28 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:29 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.dd30b6bc-96c3-4645-ae00-2cbc4508f622" returned: 0 in 0.293s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-dd30b6bc-96c3-4645-ae00-2cbc4508f622" released by "_delete_snapshot" :: held 1.912s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" released by "delete_snapshot" :: held 1.959s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Created reservations ['e281d303-8757-49e8-be79-16629dc04fb8', '0bd5aafc-4e7c-41d7-8eaa-6183ab73c3cb', '0c8933e9-d0f5-4f89-a8d1-fe70508b4708', '6a2c4745-20c4-4c82-b8ea-3721015aa772'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Delete snapshot completed successfully. Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80f988b4-2504-46be-99e6-8ee160713953 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-dd30b6bc-96c3-4645-ae00-2cbc4508f622-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-64b70aa7-afce-432d-9e90-42a8d09f28e3-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-64b70aa7-afce-432d-9e90-42a8d09f28e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-64b70aa7-afce-432d-9e90-42a8d09f28e3" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-64b70aa7-afce-432d-9e90-42a8d09f28e3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Deleting offline snapshot 64b70aa7-afce-432d-9e90-42a8d09f28e3 of volume 3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] snapshot_file for this snap is: volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573f4f6-e813-4bdf-a553-73b405bcb64e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:29 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:29 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:30 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de9c7c-fa6e-4845-bb49-95f1b8cfbe39]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:30 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b Jul 29 16:12:30 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:30 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b" returned: 0 in 0.491s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:30 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:30 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:30 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.405s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:30 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3 Jul 29 16:12:30 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:31 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b.64b70aa7-afce-432d-9e90-42a8d09f28e3" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-64b70aa7-afce-432d-9e90-42a8d09f28e3" released by "_delete_snapshot" :: held 1.790s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" released by "delete_snapshot" :: held 1.824s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Created reservations ['339538ea-bf24-4db5-9b6b-bd5a6bbba93c', '6f7ba3fd-8953-425c-b994-208c985ec8e4', 'edd2666a-47eb-40f6-9f27-1dafe0cd211c', 'b5f013a1-16e7-4db5-9996-9fd6194814fc'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Delete snapshot completed successfully. Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7dd79ec-f203-41f6-ac1e-a8a1cdc18aab tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-64b70aa7-afce-432d-9e90-42a8d09f28e3-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-3fb5219f-3e99-4f68-a5df-c4fad88f286b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-3fb5219f-3e99-4f68-a5df-c4fad88f286b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0e7039-840d-4cc0-a6fd-27b3e0ce54a3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:12:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:32 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b Jul 29 16:12:32 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:32 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b" returned: 0 in 0.500s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:12:32 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b Jul 29 16:12:32 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Flow 'volume_create_manager' (2d448ce5-4d27-4186-bfbb-12100b52ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d3a96f-f3f0-4898-98fa-1e2983e59088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d3a96f-f3f0-4898-98fa-1e2983e59088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-830865493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a8781a-ddf5-4f89-96e2-c53acec0714e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c223062521447ebebee78a72749de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:12:32Z,use_quota=True,user_id='09bf66349b97451f9fa63053d45dfe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481464ba-07f6-4984-8a9c-b3d2600089e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481464ba-07f6-4984-8a9c-b3d2600089e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39060714-5669-4b91-891c-94a3404fc1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39060714-5669-4b91-891c-94a3404fc1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a8781a-ddf5-4f89-96e2-c53acec0714e', 'volume_name': 'volume-51a8781a-ddf5-4f89-96e2-c53acec0714e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b227331d-77fb-49af-a2b1-0928ad4b8495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b227331d-77fb-49af-a2b1-0928ad4b8495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36bcd47-79e2-44dd-ba5b-dd794049464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:32 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Volume 51a8781a-ddf5-4f89-96e2-c53acec0714e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a8781a-ddf5-4f89-96e2-c53acec0714e', 'volume_size': 1} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-830865493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a8781a-ddf5-4f89-96e2-c53acec0714e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c223062521447ebebee78a72749de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:12:32Z,use_quota=True,user_id='09bf66349b97451f9fa63053d45dfe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Creating volume 51a8781a-ddf5-4f89-96e2-c53acec0714e {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:12:32 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:32 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e 1073741824 Jul 29 16:12:32 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:32 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3fb5219f-3e99-4f68-a5df-c4fad88f286b" returned: 0 in 0.329s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-quobyte-3fb5219f-3e99-4f68-a5df-c4fad88f286b" released by "delete_volume" :: held 0.924s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Created reservations ['25a060ee-4266-4693-bd8e-5315ebd3dd87', '8a0c5c3d-714b-4f61-b6c6-fa16b294b5ad', '53c38f78-18db-4a44-b6be-3510ea0e3ead', '5ba0cdb4-2a47-4757-80fb-51fd191f4ade'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:32 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:12:32 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:33 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.282s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:12:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Deleted volume successfully. Jul 29 16:12:33 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3c96571-ed7d-4951-b5c0-90e9847d9d54 tempest-VolumesSnapshotListTestJSON-1103397662 None] Lock "cinder-3fb5219f-3e99-4f68-a5df-c4fad88f286b-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e 1073741824" returned: 0 in 0.690s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:33 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e Jul 29 16:12:33 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:33 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36bcd47-79e2-44dd-ba5b-dd794049464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a8781a-ddf5-4f89-96e2-c53acec0714e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8937761a-a5b1-47fc-b6f8-a2d0f83397ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:12:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Volume volume-51a8781a-ddf5-4f89-96e2-c53acec0714e (51a8781a-ddf5-4f89-96e2-c53acec0714e): created successfully Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8937761a-a5b1-47fc-b6f8-a2d0f83397ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:12:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Flow 'volume_create_manager' (2d448ce5-4d27-4186-bfbb-12100b52ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:12:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-eb9759cd-7cbc-4c8b-90aa-a30e574e3194 tempest-AttachVolumeShelveTestJSON-470420164 None] Created volume successfully. Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:12:36 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:12:36 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:12:37 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 29 16:12:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.671s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:12:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:12:43 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=114,cinder:DELETE=13,cinder:INSERT=50,cinder:SELECT=115 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:12:43 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:INSERT=37,cinder:SELECT=119,cinder:UPDATE=135,cinder:DELETE=6 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:12:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-00c2aac7-70e7-473b-80ce-51f129d03229 req-44fbf6d4-f3e3-4238-9d5f-cf5ffd3540f9 tempest-TestShelveInstance-396051194 None] Terminate volume connection completed successfully. Jul 29 16:12:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-00c2aac7-70e7-473b-80ce-51f129d03229 req-44fbf6d4-f3e3-4238-9d5f-cf5ffd3540f9 tempest-TestShelveInstance-396051194 None] Deleting attachment 0d989b36-8b13-4913-9882-953d3681ccbd. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:12:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-fb920cf3-6bb1-4650-84f1-2eb436ff8d99 req-1eab930f-f520-4945-aa61-4542a321fb26 tempest-AttachVolumeShelveTestJSON-470420164 None] No connector for attachment a8893ce9-5584-40eb-ba64-129e58bc895b; skipping storage backend terminate_connection call. {{(pid=88575) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 29 16:12:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-fb920cf3-6bb1-4650-84f1-2eb436ff8d99 req-1eab930f-f520-4945-aa61-4542a321fb26 tempest-AttachVolumeShelveTestJSON-470420164 None] Deleting attachment a8893ce9-5584-40eb-ba64-129e58bc895b. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:12:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c6397185-e146-4d80-8af5-512f8fda0274 req-60d21b5c-7db4-40c3-945c-a62751535f8c tempest-TestShelveInstance-396051194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:12:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c6397185-e146-4d80-8af5-512f8fda0274 req-60d21b5c-7db4-40c3-945c-a62751535f8c tempest-TestShelveInstance-396051194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:12:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c6397185-e146-4d80-8af5-512f8fda0274 req-60d21b5c-7db4-40c3-945c-a62751535f8c tempest-TestShelveInstance-396051194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:12:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-c6397185-e146-4d80-8af5-512f8fda0274 req-60d21b5c-7db4-40c3-945c-a62751535f8c tempest-TestShelveInstance-396051194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9af18ac3-bed6-46d1-9108-a650ed0cde36', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:12:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-c6397185-e146-4d80-8af5-512f8fda0274 req-60d21b5c-7db4-40c3-945c-a62751535f8c tempest-TestShelveInstance-396051194 None] attachment_update completed successfully. Jul 29 16:13:02 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:13:02 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Flow 'volume_create_manager' (0e2f38ad-6a03-4f41-9621-8c3c4f5b4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a242dff-a415-4342-b208-44e670699c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a242dff-a415-4342-b208-44e670699c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1833416105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9602703c-4804-4c0b-b83a-0a9fd3abcf62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dce14a636564165b39ba81c94b92995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:08Z,use_quota=True,user_id='c89cdc17420f4102be2d162c212cc3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b060e05-a000-4f5c-8132-2a6bb3dd8634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b060e05-a000-4f5c-8132-2a6bb3dd8634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2ef2c3-7838-40c0-818b-a5301abbb0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2ef2c3-7838-40c0-818b-a5301abbb0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9602703c-4804-4c0b-b83a-0a9fd3abcf62', 'volume_name': 'volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0c718e-3eda-4893-af15-97bc090374e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0c718e-3eda-4893-af15-97bc090374e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c0fa4-6b8c-4f12-9a25-8b71fdc1ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:08 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Volume 9602703c-4804-4c0b-b83a-0a9fd3abcf62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62', 'volume_size': 1} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1833416105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9602703c-4804-4c0b-b83a-0a9fd3abcf62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dce14a636564165b39ba81c94b92995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:08Z,use_quota=True,user_id='c89cdc17420f4102be2d162c212cc3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Creating volume 9602703c-4804-4c0b-b83a-0a9fd3abcf62 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:13:08 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:13:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:08 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 1073741824 Jul 29 16:13:08 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:10 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 1073741824" returned: 0 in 1.200s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:10 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 Jul 29 16:13:10 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:10 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62" returned: 0 in 0.514s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c0fa4-6b8c-4f12-9a25-8b71fdc1ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39556bf-e340-4707-8ecf-e9340d7e70f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Volume volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 (9602703c-4804-4c0b-b83a-0a9fd3abcf62): created successfully Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39556bf-e340-4707-8ecf-e9340d7e70f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Flow 'volume_create_manager' (0e2f38ad-6a03-4f41-9621-8c3c4f5b4231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-060941d3-c83d-488f-8c10-41e89ffe9b76 tempest-TestMinimumBasicScenario-232902261 None] Created volume successfully. Jul 29 16:13:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c705cccf-4351-4622-a95b-00a3780f968d req-0dd1fc11-0677-4fed-93b7-10482549dd0f tempest-TestMinimumBasicScenario-232902261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c705cccf-4351-4622-a95b-00a3780f968d req-0dd1fc11-0677-4fed-93b7-10482549dd0f tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c705cccf-4351-4622-a95b-00a3780f968d req-0dd1fc11-0677-4fed-93b7-10482549dd0f tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-c705cccf-4351-4622-a95b-00a3780f968d req-0dd1fc11-0677-4fed-93b7-10482549dd0f tempest-TestMinimumBasicScenario-232902261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7958cf37-a278-4ede-9328-333b63274a06', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:13:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-c705cccf-4351-4622-a95b-00a3780f968d req-0dd1fc11-0677-4fed-93b7-10482549dd0f tempest-TestMinimumBasicScenario-232902261 None] attachment_update completed successfully. Jul 29 16:13:25 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:13:25 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:INSERT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:13:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:13:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Flow 'volume_create_manager' (82bf9f41-b830-4f15-a474-59f1f45e22f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41d1d76-1db9-464b-84dd-2d4acded5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41d1d76-1db9-464b-84dd-2d4acded5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-966578029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b2464c-bda0-437c-9679-db4629e457f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffac64aaebc840d0bf1ab611e337221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:27Z,use_quota=True,user_id='04a7f24375804ad5bada4b6530ae6abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(002ed095-f12f-4ff7-bff4-59dfd47460ae),volume_type_id=002ed095-f12f-4ff7-bff4-59dfd47460ae)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cc7ff7-9e56-4568-9e6e-7cd3c12cfa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cc7ff7-9e56-4568-9e6e-7cd3c12cfa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a8c200-4e8f-49e3-afab-e46595123563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a8c200-4e8f-49e3-afab-e46595123563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b2464c-bda0-437c-9679-db4629e457f8', 'volume_name': 'volume-33b2464c-bda0-437c-9679-db4629e457f8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156c1c84-1411-415c-adef-e71eb7fb1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156c1c84-1411-415c-adef-e71eb7fb1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e2f7da-e354-4a92-9754-9399724c86ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:27 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Volume 33b2464c-bda0-437c-9679-db4629e457f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b2464c-bda0-437c-9679-db4629e457f8', 'volume_size': 1} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-966578029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b2464c-bda0-437c-9679-db4629e457f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffac64aaebc840d0bf1ab611e337221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:27Z,use_quota=True,user_id='04a7f24375804ad5bada4b6530ae6abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(002ed095-f12f-4ff7-bff4-59dfd47460ae),volume_type_id=002ed095-f12f-4ff7-bff4-59dfd47460ae)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Creating volume 33b2464c-bda0-437c-9679-db4629e457f8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:13:27 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:27 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 1073741824 Jul 29 16:13:27 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Flow 'volume_create_manager' (49684422-4394-44f7-93c6-be74d875c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db36e3d5-6d40-4c54-a14f-48888477b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db36e3d5-6d40-4c54-a14f-48888477b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-138512548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da00ef0-8c02-4770-8842-222f098db712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffac64aaebc840d0bf1ab611e337221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:28Z,use_quota=True,user_id='04a7f24375804ad5bada4b6530ae6abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b703dfa-b658-4e7d-b49c-11a400b6846d),volume_type_id=8b703dfa-b658-4e7d-b49c-11a400b6846d)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dcda07-a343-4dd9-bcdf-4741bde90ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:28 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dcda07-a343-4dd9-bcdf-4741bde90ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e838e470-923e-4a4f-927d-4f4fd6fbf8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e838e470-923e-4a4f-927d-4f4fd6fbf8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da00ef0-8c02-4770-8842-222f098db712', 'volume_name': 'volume-9da00ef0-8c02-4770-8842-222f098db712', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5187cb8-d883-4e60-a834-884ce28894b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5187cb8-d883-4e60-a834-884ce28894b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d8500d-1927-4e77-99df-47da54850716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:28 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Volume 9da00ef0-8c02-4770-8842-222f098db712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da00ef0-8c02-4770-8842-222f098db712', 'volume_size': 1} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 1073741824" returned: 0 in 0.979s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:28 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 Jul 29 16:13:28 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:28 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8" returned: 0 in 0.495s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-138512548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da00ef0-8c02-4770-8842-222f098db712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffac64aaebc840d0bf1ab611e337221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:28Z,use_quota=True,user_id='04a7f24375804ad5bada4b6530ae6abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b703dfa-b658-4e7d-b49c-11a400b6846d),volume_type_id=8b703dfa-b658-4e7d-b49c-11a400b6846d)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Creating volume 9da00ef0-8c02-4770-8842-222f098db712 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:13:28 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:28 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 1073741824 Jul 29 16:13:28 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e2f7da-e354-4a92-9754-9399724c86ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b2464c-bda0-437c-9679-db4629e457f8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d70205-1bae-421e-a8d5-f9fce511ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:28 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Volume volume-33b2464c-bda0-437c-9679-db4629e457f8 (33b2464c-bda0-437c-9679-db4629e457f8): created successfully Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d70205-1bae-421e-a8d5-f9fce511ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Flow 'volume_create_manager' (82bf9f41-b830-4f15-a474-59f1f45e22f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8c5efd68-38d6-4e65-a914-66ddfc0a6e64 tempest-TestInstancesWithCinderVolumes-716812905 None] Created volume successfully. Jul 29 16:13:28 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Flow 'volume_create_manager' (f2d4f410-3127-4798-b5ba-9ccb1ff3ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fef3dd-08a0-401c-943e-deaaaaa9cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fef3dd-08a0-401c-943e-deaaaaa9cb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-628043027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db136a2f-7675-4c35-8efe-55e0796ea9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffac64aaebc840d0bf1ab611e337221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:29Z,use_quota=True,user_id='04a7f24375804ad5bada4b6530ae6abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(640614ff-139d-42fb-926a-7b8564cfab97),volume_type_id=640614ff-139d-42fb-926a-7b8564cfab97)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233ff99d-3b77-42cc-9d31-940845c586d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233ff99d-3b77-42cc-9d31-940845c586d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de35990d-990c-43f0-8d71-621439fcc895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:13:29 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 1073741824" returned: 0 in 0.789s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de35990d-990c-43f0-8d71-621439fcc895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db136a2f-7675-4c35-8efe-55e0796ea9be', 'volume_name': 'volume-db136a2f-7675-4c35-8efe-55e0796ea9be', 'volume_size': 1, 'image_id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6533c084-169a-4c76-8570-cbfc73d70b71', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1532387740', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ffac64aaebc840d0bf1ab611e337221c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'created_at': datetime.datetime(2026, 7, 29, 14, 13, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 13, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6533c084-169a-4c76-8570-cbfc73d70b71/file', 'properties': {}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de19c6d7-96a6-4324-a913-2c0deefc0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de19c6d7-96a6-4324-a913-2c0deefc0505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b7389-1450-4e8c-988b-3e6fee28fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:29 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Volume db136a2f-7675-4c35-8efe-55e0796ea9be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db136a2f-7675-4c35-8efe-55e0796ea9be', 'volume_size': 1, 'image_id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6533c084-169a-4c76-8570-cbfc73d70b71', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1532387740', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ffac64aaebc840d0bf1ab611e337221c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'created_at': datetime.datetime(2026, 7, 29, 14, 13, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 13, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6533c084-169a-4c76-8570-cbfc73d70b71/file', 'properties': {}}, 'image_service': } Jul 29 16:13:29 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Trying to clone db136a2f-7675-4c35-8efe-55e0796ea9be from image 6533c084-169a-4c76-8570-cbfc73d70b71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6533c084-169a-4c76-8570-cbfc73d70b71', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:13:29 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 Jul 29 16:13:29 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:30 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712" returned: 0 in 0.652s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d8500d-1927-4e77-99df-47da54850716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da00ef0-8c02-4770-8842-222f098db712', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05a0344-964f-4f41-a43b-2b1fc757862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:30 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Volume volume-9da00ef0-8c02-4770-8842-222f098db712 (9da00ef0-8c02-4770-8842-222f098db712): created successfully Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05a0344-964f-4f41-a43b-2b1fc757862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Flow 'volume_create_manager' (49684422-4394-44f7-93c6-be74d875c426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:30 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-14a03478-6669-40e0-9df1-768d5a4694cc tempest-TestInstancesWithCinderVolumes-716812905 None] Created volume successfully. Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD, size 20.69 MB, duration 4.49 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:13:34 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Image download 20.69 MB at 4.60 MB/s Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9743de6-0ce8-4fbe-ae8d-dfc3034592cc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:34 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD Jul 29 16:13:34 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:34 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Temporary image 6533c084-169a-4c76-8570-cbfc73d70b71 is fetched for user 04a7f24375804ad5bada4b6530ae6abe. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc9374e-95d6-408c-b26f-fa6834b79a0e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:34 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD Jul 29 16:13:34 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:34 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-628043027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db136a2f-7675-4c35-8efe-55e0796ea9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffac64aaebc840d0bf1ab611e337221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:13:29Z,use_quota=True,user_id='04a7f24375804ad5bada4b6530ae6abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(640614ff-139d-42fb-926a-7b8564cfab97),volume_type_id=640614ff-139d-42fb-926a-7b8564cfab97)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Creating volume db136a2f-7675-4c35-8efe-55e0796ea9be {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:13:34 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:13:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:35 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be 1073741824 Jul 29 16:13:35 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:35 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be 1073741824" returned: 0 in 0.433s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:35 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be Jul 29 16:13:35 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:35 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be" returned: 0 in 0.255s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Attempting download of 6533c084-169a-4c76-8570-cbfc73d70b71 ((None, [{'url': 'file:///opt/stack/data/glance/images/6533c084-169a-4c76-8570-cbfc73d70b71', 'metadata': {}}])) to volume db136a2f-7675-4c35-8efe-55e0796ea9be. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[51130919-7fb4-428a-9e99-f99d4ce8dc21]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:13:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:35 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1 Jul 29 16:13:35 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:36 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1" returned: 0 in 0.320s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:36 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1 Jul 29 16:13:36 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:36 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1" returned: 1 in 0.332s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6533c084-169a-4c76-8570-cbfc73d70b71_k0ajuoi1' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a087b2c6-0b4e-440b-89b8-42e5104a1787]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:36 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD Jul 29 16:13:36 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:36 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] 6533c084-169a-4c76-8570-cbfc73d70b71 was qcow2, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:36 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:13:36 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:36 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be Jul 29 16:13:36 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:36 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:13:38 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be" returned: 0 in 1.645s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6533c084-169a-4c76-8570-cbfc73d70b71_zk2544isdevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:13:38 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Converted 112.00 MB image at 68.04 MB/s Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:38 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be 1G Jul 29 16:13:38 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:38 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be 1G" returned: 0 in 0.302s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Downloaded image 6533c084-169a-4c76-8570-cbfc73d70b71 ((None, [{'url': 'file:///opt/stack/data/glance/images/6533c084-169a-4c76-8570-cbfc73d70b71', 'metadata': {}}])) to volume db136a2f-7675-4c35-8efe-55e0796ea9be successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Temporary image 6533c084-169a-4c76-8570-cbfc73d70b71 for user 04a7f24375804ad5bada4b6530ae6abe is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Marking volume db136a2f-7675-4c35-8efe-55e0796ea9be as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Copying metadata from image 6533c084-169a-4c76-8570-cbfc73d70b71 to db136a2f-7675-4c35-8efe-55e0796ea9be. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Creating volume glance metadata for volume db136a2f-7675-4c35-8efe-55e0796ea9be backed by image 6533c084-169a-4c76-8570-cbfc73d70b71 with: {'image_id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'image_name': 'tempest-scenario-img--1532387740', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b7389-1450-4e8c-988b-3e6fee28fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db136a2f-7675-4c35-8efe-55e0796ea9be', 'volume_size': 1, 'image_id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6533c084-169a-4c76-8570-cbfc73d70b71', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1532387740', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ffac64aaebc840d0bf1ab611e337221c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6533c084-169a-4c76-8570-cbfc73d70b71', 'created_at': datetime.datetime(2026, 7, 29, 14, 13, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 13, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6533c084-169a-4c76-8570-cbfc73d70b71/file', 'properties': {}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73c3aab-0134-44c0-bbfe-62627ce8f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:13:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Volume volume-db136a2f-7675-4c35-8efe-55e0796ea9be (db136a2f-7675-4c35-8efe-55e0796ea9be): created successfully Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73c3aab-0134-44c0-bbfe-62627ce8f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:13:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Flow 'volume_create_manager' (f2d4f410-3127-4798-b5ba-9ccb1ff3ab25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:13:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6c8100cf-f311-430a-9b12-8f64a507465b tempest-TestInstancesWithCinderVolumes-716812905 None] Created volume successfully. Jul 29 16:13:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-520194b1-ac52-4afa-84fe-c3fd69f68e1e req-c7142dd3-ee24-4238-a000-0d7ef71148f8 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-520194b1-ac52-4afa-84fe-c3fd69f68e1e req-c7142dd3-ee24-4238-a000-0d7ef71148f8 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-520194b1-ac52-4afa-84fe-c3fd69f68e1e req-c7142dd3-ee24-4238-a000-0d7ef71148f8 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-520194b1-ac52-4afa-84fe-c3fd69f68e1e req-c7142dd3-ee24-4238-a000-0d7ef71148f8 tempest-TestInstancesWithCinderVolumes-716812905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-db136a2f-7675-4c35-8efe-55e0796ea9be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1f36f6f-b7e5-452f-8369-c1db789ba897', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:13:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-520194b1-ac52-4afa-84fe-c3fd69f68e1e req-c7142dd3-ee24-4238-a000-0d7ef71148f8 tempest-TestInstancesWithCinderVolumes-716812905 None] attachment_update completed successfully. Jul 29 16:13:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-fb3b936b-1625-49c8-b8f4-f2bb05e312c0 tempest-TestShelveInstance-396051194 None] Terminate volume connection completed successfully. Jul 29 16:13:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-fb3b936b-1625-49c8-b8f4-f2bb05e312c0 tempest-TestShelveInstance-396051194 None] Deleting attachment 9af18ac3-bed6-46d1-9108-a650ed0cde36. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Acquiring lock "cinder-59ea3783-7fae-40a1-a4c4-fbd360e6d59b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Lock "cinder-59ea3783-7fae-40a1-a4c4-fbd360e6d59b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Acquiring lock "cinder-quobyte-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Lock "cinder-quobyte-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" acquired by "delete_volume" :: waited 0.039s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6d8e7-0370-443f-a6a5-d70125524b8a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:45 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b Jul 29 16:13:45 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:45 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" returned: 0 in 0.658s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:45 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b Jul 29 16:13:45 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:46 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" returned: 0 in 0.465s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Lock "cinder-quobyte-59ea3783-7fae-40a1-a4c4-fbd360e6d59b" released by "delete_volume" :: held 1.192s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG cinder.quota [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Created reservations ['e43a2284-c8bc-40e3-90ef-6f21be03bed9', '1ddd0222-67b0-4c2a-9898-ab7bf102bb0f', 'b2af8008-01de-4d96-8ed5-a4b377939cdf', '4d7a140c-416f-43ab-9f09-ecda0b51a002'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:46 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:13:46 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:47 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.537s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:47 devstack cinder-volume[88575]: DEBUG cinder.manager [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:13:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Deleted volume successfully. Jul 29 16:13:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [req-13d9df5f-d1a6-4edc-b260-3b9ab0890a23 req-cd2669a0-e499-4158-8818-1f88d9685d41 tempest-TestShelveInstance-396051194 None] Lock "cinder-59ea3783-7fae-40a1-a4c4-fbd360e6d59b-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:13:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Acquiring lock "cinder-51a8781a-ddf5-4f89-96e2-c53acec0714e-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:13:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "cinder-51a8781a-ddf5-4f89-96e2-c53acec0714e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:13:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Acquiring lock "cinder-quobyte-51a8781a-ddf5-4f89-96e2-c53acec0714e" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:13:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "cinder-quobyte-51a8781a-ddf5-4f89-96e2-c53acec0714e" acquired by "delete_volume" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:13:49 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd22073-f6b1-4874-ab88-d01332797f0f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:13:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:49 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e Jul 29 16:13:49 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:50 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e" returned: 0 in 0.819s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:50 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e Jul 29 16:13:50 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:51 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-51a8781a-ddf5-4f89-96e2-c53acec0714e" returned: 0 in 0.746s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "cinder-quobyte-51a8781a-ddf5-4f89-96e2-c53acec0714e" released by "delete_volume" :: held 1.644s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Created reservations ['b4823d2c-3ebd-4737-8d0c-350e8600ef0b', '2e64087e-c810-47e4-bcf5-ea2113827f6e', '6896b447-0420-45e0-94ea-7e8af399ae1a', '28051302-4336-4e2b-9501-4d03f5edddf0'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:13:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:13:51 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:13:51 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:13:52 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 29 16:13:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.516s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:13:52 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:13:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Deleted volume successfully. Jul 29 16:13:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-562c21da-bf20-4da4-9972-52052a77c0fa tempest-AttachVolumeShelveTestJSON-470420164 None] Lock "cinder-51a8781a-ddf5-4f89-96e2-c53acec0714e-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=28,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=10 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:14:02 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=31,cinder:UPDATE=24,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Flow 'volume_create_manager' (31556ad4-761d-422c-a5c4-7b8ea902d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970fa4b0-093e-4796-bce5-567c9cb7ce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970fa4b0-093e-4796-bce5-567c9cb7ce8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c9ce1c-a811-4823-b992-6f526c1335a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1cd7a3fcc84ea9b09714c326f0bfb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:12Z,use_quota=True,user_id='f16a036669d54567b15dccd1a5505ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bda420f-58f8-4797-8474-30ba43d0627e),volume_type_id=8bda420f-58f8-4797-8474-30ba43d0627e)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46fa4ec-719f-4c57-9012-2c9107940bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46fa4ec-719f-4c57-9012-2c9107940bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d145f1-ec20-4fd9-bba9-7604b0c4ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d145f1-ec20-4fd9-bba9-7604b0c4ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1c9ce1c-a811-4823-b992-6f526c1335a6', 'volume_name': 'volume-c1c9ce1c-a811-4823-b992-6f526c1335a6', 'volume_size': 1, 'image_id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd6776d5-6bda-423a-84d8-11be27d36805', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccaf11f3b7c299d67bf2048843403279', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e1cd7a3fcc84ea9b09714c326f0bfb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00bb3c0a82562a5ab1da16fc7559ed06e48b73f4bb64eb638f58ed163bb2c9cb1848448e431891145d770af7aaea00af859b627b1fcc07d02cd294c475025aab', 'id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'created_at': datetime.datetime(2026, 7, 29, 14, 14, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd6776d5-6bda-423a-84d8-11be27d36805/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e47dd4-f0e5-4e62-8a92-d08310f737f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e47dd4-f0e5-4e62-8a92-d08310f737f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c434aba-8fdb-4794-a601-25d0b01e1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Volume c1c9ce1c-a811-4823-b992-6f526c1335a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1c9ce1c-a811-4823-b992-6f526c1335a6', 'volume_size': 1, 'image_id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd6776d5-6bda-423a-84d8-11be27d36805', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccaf11f3b7c299d67bf2048843403279', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e1cd7a3fcc84ea9b09714c326f0bfb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00bb3c0a82562a5ab1da16fc7559ed06e48b73f4bb64eb638f58ed163bb2c9cb1848448e431891145d770af7aaea00af859b627b1fcc07d02cd294c475025aab', 'id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'created_at': datetime.datetime(2026, 7, 29, 14, 14, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd6776d5-6bda-423a-84d8-11be27d36805/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 29 16:14:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Trying to clone c1c9ce1c-a811-4823-b992-6f526c1335a6 from image dd6776d5-6bda-423a-84d8-11be27d36805 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd6776d5-6bda-423a-84d8-11be27d36805', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:14:13 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:14:13 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Image download 0.00 MB at 0.00 MB/s Jul 29 16:14:13 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a84c62-7aa9-46fb-b12c-603e2b78f38d]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:13 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD Jul 29 16:14:13 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:13 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:13 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD Jul 29 16:14:13 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD" returned: 1 in 0.465s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Temporary image dd6776d5-6bda-423a-84d8-11be27d36805 is fetched for user f16a036669d54567b15dccd1a5505ba7. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:14:14 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69d7e28-c3a1-4a7d-9e29-d1f2d9325262]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:14 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD Jul 29 16:14:14 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:14 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:15 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD Jul 29 16:14:15 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:15 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c9ce1c-a811-4823-b992-6f526c1335a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1cd7a3fcc84ea9b09714c326f0bfb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:12Z,use_quota=True,user_id='f16a036669d54567b15dccd1a5505ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bda420f-58f8-4797-8474-30ba43d0627e),volume_type_id=8bda420f-58f8-4797-8474-30ba43d0627e)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Creating volume c1c9ce1c-a811-4823-b992-6f526c1335a6 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:14:15 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:15 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 1073741824 Jul 29 16:14:15 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-34376654-579d-4ab6-b5d6-63a6113fcf4b req-acfed5e2-345a-4aab-9c0d-72b66e56cddc tempest-TestMinimumBasicScenario-232902261 None] Terminate volume connection completed successfully. Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-34376654-579d-4ab6-b5d6-63a6113fcf4b req-acfed5e2-345a-4aab-9c0d-72b66e56cddc tempest-TestMinimumBasicScenario-232902261 None] Deleting attachment 7958cf37-a278-4ede-9328-333b63274a06. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:14:15 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 1073741824" returned: 0 in 0.641s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Acquiring lock "cinder-9602703c-4804-4c0b-b83a-0a9fd3abcf62-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Lock "cinder-9602703c-4804-4c0b-b83a-0a9fd3abcf62-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Acquiring lock "cinder-quobyte-9602703c-4804-4c0b-b83a-0a9fd3abcf62" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:16 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 Jul 29 16:14:16 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Lock "cinder-quobyte-9602703c-4804-4c0b-b83a-0a9fd3abcf62" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c8bcfe-a1fe-4f7d-9673-25ae111d8ae9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:16 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 Jul 29 16:14:16 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:16 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6" returned: 0 in 0.274s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Attempting download of dd6776d5-6bda-423a-84d8-11be27d36805 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd6776d5-6bda-423a-84d8-11be27d36805', 'metadata': {}}])) to volume c1c9ce1c-a811-4823-b992-6f526c1335a6. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951f957-793b-42db-96ff-5600653d2153]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:16 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:16 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5 Jul 29 16:14:16 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:16 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62 Jul 29 16:14:16 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:16 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5" returned: 0 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:16 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9602703c-4804-4c0b-b83a-0a9fd3abcf62" returned: 0 in 0.336s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Lock "cinder-quobyte-9602703c-4804-4c0b-b83a-0a9fd3abcf62" released by "delete_volume" :: held 0.831s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:17 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5 Jul 29 16:14:17 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Created reservations ['740d3395-811f-4756-b69b-7c3823fd0a04', '2426e439-3a85-425e-abac-b2be1362250c', '6f5ff7cc-4bb1-4761-8469-4c2b07749ba1', '5ef05837-804e-4523-9d05-6163b010b36b'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:17 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:17 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:17 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5" returned: 1 in 0.476s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd6776d5-6bda-423a-84d8-11be27d36805_h9pqdzy5' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9afe848-97e2-4c07-b5d1-51d108d2a80c]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:17 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD Jul 29 16:14:17 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:17 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Deleted volume successfully. Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9f823307-ae73-4f12-ad57-4f40befc41f9 tempest-TestMinimumBasicScenario-232902261 None] Lock "cinder-9602703c-4804-4c0b-b83a-0a9fd3abcf62-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:17 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:18 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD Jul 29 16:14:18 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:18 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD" returned: 1 in 0.533s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:14:18 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] dd6776d5-6bda-423a-84d8-11be27d36805 was raw, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:14:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:18 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 Jul 29 16:14:18 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:19 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6" returned: 0 in 0.767s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd6776d5-6bda-423a-84d8-11be27d36805_juer1n1pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:14:19 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Converted 0.00 MB image at 0.00 MB/s Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:19 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 1G Jul 29 16:14:19 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:19 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 1G" returned: 0 in 0.496s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Downloaded image dd6776d5-6bda-423a-84d8-11be27d36805 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd6776d5-6bda-423a-84d8-11be27d36805', 'metadata': {}}])) to volume c1c9ce1c-a811-4823-b992-6f526c1335a6 successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Temporary image dd6776d5-6bda-423a-84d8-11be27d36805 for user f16a036669d54567b15dccd1a5505ba7 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Marking volume c1c9ce1c-a811-4823-b992-6f526c1335a6 as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Copying metadata from image dd6776d5-6bda-423a-84d8-11be27d36805 to c1c9ce1c-a811-4823-b992-6f526c1335a6. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Creating volume glance metadata for volume c1c9ce1c-a811-4823-b992-6f526c1335a6 backed by image dd6776d5-6bda-423a-84d8-11be27d36805 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ccaf11f3b7c299d67bf2048843403279', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c434aba-8fdb-4794-a601-25d0b01e1667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c9ce1c-a811-4823-b992-6f526c1335a6', 'volume_size': 1, 'image_id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd6776d5-6bda-423a-84d8-11be27d36805', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccaf11f3b7c299d67bf2048843403279', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e1cd7a3fcc84ea9b09714c326f0bfb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00bb3c0a82562a5ab1da16fc7559ed06e48b73f4bb64eb638f58ed163bb2c9cb1848448e431891145d770af7aaea00af859b627b1fcc07d02cd294c475025aab', 'id': 'dd6776d5-6bda-423a-84d8-11be27d36805', 'created_at': datetime.datetime(2026, 7, 29, 14, 14, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd6776d5-6bda-423a-84d8-11be27d36805/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd90b7fb-a684-4ef9-9366-bbc6f7c2ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:19 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Volume volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 (c1c9ce1c-a811-4823-b992-6f526c1335a6): created successfully Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd90b7fb-a684-4ef9-9366-bbc6f7c2ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Flow 'volume_create_manager' (31556ad4-761d-422c-a5c4-7b8ea902d05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-550464ba-8bf7-49d0-a006-f478515be9d1 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Created volume successfully. Jul 29 16:14:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Acquiring lock "cinder-c1c9ce1c-a811-4823-b992-6f526c1335a6-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "cinder-c1c9ce1c-a811-4823-b992-6f526c1335a6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Acquiring lock "cinder-quobyte-c1c9ce1c-a811-4823-b992-6f526c1335a6" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "cinder-quobyte-c1c9ce1c-a811-4823-b992-6f526c1335a6" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b72f5c-ad4d-4041-83d9-33877f013435]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:22 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 Jul 29 16:14:22 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:22 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:23 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6 Jul 29 16:14:23 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:23 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c1c9ce1c-a811-4823-b992-6f526c1335a6" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "cinder-quobyte-c1c9ce1c-a811-4823-b992-6f526c1335a6" released by "delete_volume" :: held 0.669s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:24 devstack cinder-volume[88575]: WARNING cinder.quota [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:24 devstack cinder-volume[88575]: WARNING cinder.quota [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Created reservations ['5d7c0508-9e35-442c-b230-193dcd5bf24a', 'e554eab5-e858-4749-b7d1-a3c4493867ec', '457a2831-12a3-4522-9ea5-e6a96b56d11c', 'c7c0a13e-328a-43ad-92de-a5ccb90938cf'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:25 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:25 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:26 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Deleted volume successfully. Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8023a333-344f-4b6c-bfbe-d197a89cb8d5 tempest-VolumeAndVolumeTypeFromImageTest-1773939052 None] Lock "cinder-c1c9ce1c-a811-4823-b992-6f526c1335a6-delete_volume" released by "delete_volume" :: held 5.113s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-92e00a82-f8f0-42d5-bf4e-d467008138f9 req-8fb15d5d-69e4-4266-97f7-0dc2e5478fb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-92e00a82-f8f0-42d5-bf4e-d467008138f9 req-8fb15d5d-69e4-4266-97f7-0dc2e5478fb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-92e00a82-f8f0-42d5-bf4e-d467008138f9 req-8fb15d5d-69e4-4266-97f7-0dc2e5478fb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-92e00a82-f8f0-42d5-bf4e-d467008138f9 req-8fb15d5d-69e4-4266-97f7-0dc2e5478fb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-33b2464c-bda0-437c-9679-db4629e457f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a7d9baf-c7ea-4d06-9cf7-31b3f2e44673', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:14:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-92e00a82-f8f0-42d5-bf4e-d467008138f9 req-8fb15d5d-69e4-4266-97f7-0dc2e5478fb9 tempest-TestInstancesWithCinderVolumes-716812905 None] attachment_update completed successfully. Jul 29 16:14:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-86bc1a47-9903-4fe0-afa3-c50c838297fc req-4370bf86-28f2-47aa-bd5a-26e059e97a8d tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-86bc1a47-9903-4fe0-afa3-c50c838297fc req-4370bf86-28f2-47aa-bd5a-26e059e97a8d tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-86bc1a47-9903-4fe0-afa3-c50c838297fc req-4370bf86-28f2-47aa-bd5a-26e059e97a8d tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-86bc1a47-9903-4fe0-afa3-c50c838297fc req-4370bf86-28f2-47aa-bd5a-26e059e97a8d tempest-TestInstancesWithCinderVolumes-716812905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-9da00ef0-8c02-4770-8842-222f098db712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d2f111e-9b08-43c9-869c-c4384cd604e5', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:14:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-86bc1a47-9903-4fe0-afa3-c50c838297fc req-4370bf86-28f2-47aa-bd5a-26e059e97a8d tempest-TestInstancesWithCinderVolumes-716812905 None] attachment_update completed successfully. Jul 29 16:14:33 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:14:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (5302c6b9-c8b2-462a-a9f7-dd5dc5d5df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb34575-5b00-438c-bf80-8a00860b733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb34575-5b00-438c-bf80-8a00860b733b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779898241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed26838-4d01-4f2e-be1f-60bdd07064bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:34Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd49be01-83d2-436d-b182-fe1348bf55f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd49be01-83d2-436d-b182-fe1348bf55f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9335cc42-1f65-471b-a43e-2b3bb95c8c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9335cc42-1f65-471b-a43e-2b3bb95c8c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed26838-4d01-4f2e-be1f-60bdd07064bb', 'volume_name': 'volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5dc4b9-5925-473d-959b-52b28bb7f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5dc4b9-5925-473d-959b-52b28bb7f344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fe98bf-d840-4809-8918-9fd36d5e174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Volume 8ed26838-4d01-4f2e-be1f-60bdd07064bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb', 'volume_size': 1} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779898241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed26838-4d01-4f2e-be1f-60bdd07064bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:34Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Creating volume 8ed26838-4d01-4f2e-be1f-60bdd07064bb {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:14:34 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:34 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb 1073741824 Jul 29 16:14:34 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (e695e609-3a8e-46bc-8c09-2dde73ad0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14356c8-0347-40fa-8e9d-894893885332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14356c8-0347-40fa-8e9d-894893885332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396975931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e36db53-c560-4a92-8717-7962432cd199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:34Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94315cb4-5066-44ed-911a-923ffbed2ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94315cb4-5066-44ed-911a-923ffbed2ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea87dfd5-70ab-4134-a78c-5ff3db342441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea87dfd5-70ab-4134-a78c-5ff3db342441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e36db53-c560-4a92-8717-7962432cd199', 'volume_name': 'volume-9e36db53-c560-4a92-8717-7962432cd199', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63412844-09e5-47c9-a9c8-df9d00c36262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63412844-09e5-47c9-a9c8-df9d00c36262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a169aaf-0f24-416e-9f58-bf24bbedcc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:34 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Volume 9e36db53-c560-4a92-8717-7962432cd199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e36db53-c560-4a92-8717-7962432cd199', 'volume_size': 1} Jul 29 16:14:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:35 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb 1073741824" returned: 0 in 1.085s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:35 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb Jul 29 16:14:35 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (aab49c08-7b54-4979-979a-fbb960c6c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706a00fe-71dd-40a8-86a0-5b029f020db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706a00fe-71dd-40a8-86a0-5b029f020db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113143688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb4a022-89a7-4f13-9ceb-c5f4afd84b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:36Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b4c780-c8ac-4372-b6a6-449491100aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b4c780-c8ac-4372-b6a6-449491100aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d57647-7159-4169-bd57-64298c45a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d57647-7159-4169-bd57-64298c45a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb4a022-89a7-4f13-9ceb-c5f4afd84b21', 'volume_name': 'volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3466a1-f412-4110-a279-ed9203a1e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3466a1-f412-4110-a279-ed9203a1e168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d786afe5-6d5a-41b3-b2c5-1ba190d3dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:35 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Volume 9fb4a022-89a7-4f13-9ceb-c5f4afd84b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21', 'volume_size': 1} Jul 29 16:14:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:35 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb" returned: 0 in 0.658s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396975931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e36db53-c560-4a92-8717-7962432cd199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:34Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Creating volume 9e36db53-c560-4a92-8717-7962432cd199 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:14:36 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fe98bf-d840-4809-8918-9fd36d5e174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfcf13b-8950-47fa-9ad6-1effe93a5acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:36 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 1073741824 Jul 29 16:14:36 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:36 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Volume volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb (8ed26838-4d01-4f2e-be1f-60bdd07064bb): created successfully Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfcf13b-8950-47fa-9ad6-1effe93a5acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (5302c6b9-c8b2-462a-a9f7-dd5dc5d5df3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-50874c94-4614-48f8-bd4b-3c6ca2133a11 tempest-CreateVolumesFromImageTest-876858461 None] Created volume successfully. Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (ca46e6e9-8059-4102-8917-b2ef90fcc98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9a7940-0444-4f19-bd84-b64ce44a8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9a7940-0444-4f19-bd84-b64ce44a8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1064226679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde7bcc8-1c85-4048-85d6-7a4cd123ab1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:36Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2f4aec-8659-4484-98ba-cc397c60b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2f4aec-8659-4484-98ba-cc397c60b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcb22c4-6715-4179-85b1-d465b9bb20d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcb22c4-6715-4179-85b1-d465b9bb20d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde7bcc8-1c85-4048-85d6-7a4cd123ab1f', 'volume_name': 'volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fcd10e-91fe-4bf7-ade2-2b101cf66401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fcd10e-91fe-4bf7-ade2-2b101cf66401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dd73ac-d0d2-4c01-99f4-3ee0db1e437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:36 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Volume bde7bcc8-1c85-4048-85d6-7a4cd123ab1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f', 'volume_size': 1} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:36 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:36 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (67414e27-83bb-48d0-9b1b-a101bd0f00f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c4b78d-c762-4982-bc35-5cf9bdc40025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:37 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 1073741824" returned: 0 in 1.076s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:37 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c4b78d-c762-4982-bc35-5cf9bdc40025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1083038381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5904bc86-a945-4e51-a704-e15db4b21c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:37Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96b898-ec39-49f0-8ad1-2d2819e36384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96b898-ec39-49f0-8ad1-2d2819e36384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ea65e6-1d53-40d6-a118-71977953aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ea65e6-1d53-40d6-a118-71977953aa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5904bc86-a945-4e51-a704-e15db4b21c3a', 'volume_name': 'volume-5904bc86-a945-4e51-a704-e15db4b21c3a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e57848d-ca64-475f-b074-42c451b4237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e57848d-ca64-475f-b074-42c451b4237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e309e2-76db-4d1e-8827-d14dc6ddffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Volume 5904bc86-a945-4e51-a704-e15db4b21c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5904bc86-a945-4e51-a704-e15db4b21c3a', 'volume_size': 1} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.486s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:37 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 Jul 29 16:14:37 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:37 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199" returned: 0 in 0.366s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113143688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb4a022-89a7-4f13-9ceb-c5f4afd84b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:36Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Creating volume 9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:14:37 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:37 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 1073741824 Jul 29 16:14:37 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a169aaf-0f24-416e-9f58-bf24bbedcc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e36db53-c560-4a92-8717-7962432cd199', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9501424-f020-4ae0-9d04-ff70fe2aee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Volume volume-9e36db53-c560-4a92-8717-7962432cd199 (9e36db53-c560-4a92-8717-7962432cd199): created successfully Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9501424-f020-4ae0-9d04-ff70fe2aee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (e695e609-3a8e-46bc-8c09-2dde73ad0d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f40bd267-98cb-4528-bdea-2f562e571e77 tempest-CreateVolumesFromImageTest-876858461 None] Created volume successfully. Jul 29 16:14:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-37979ba6-9bb0-4d5c-8d99-7159f17aa9c8 req-113866cf-5df7-4c51-b59d-4941f322c74a tempest-TestInstancesWithCinderVolumes-716812905 None] Terminate volume connection completed successfully. Jul 29 16:14:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-37979ba6-9bb0-4d5c-8d99-7159f17aa9c8 req-113866cf-5df7-4c51-b59d-4941f322c74a tempest-TestInstancesWithCinderVolumes-716812905 None] Deleting attachment 2a7d9baf-c7ea-4d06-9cf7-31b3f2e44673. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:14:38 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 1073741824" returned: 0 in 0.928s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:38 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 Jul 29 16:14:38 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:39 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21" returned: 0 in 0.412s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.591s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1064226679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde7bcc8-1c85-4048-85d6-7a4cd123ab1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:36Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Creating volume bde7bcc8-1c85-4048-85d6-7a4cd123ab1f {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:14:39 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d786afe5-6d5a-41b3-b2c5-1ba190d3dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ba75bb-6248-45e5-ba7f-4058fcb4b78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:39 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f 1073741824 Jul 29 16:14:39 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:39 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Volume volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 (9fb4a022-89a7-4f13-9ceb-c5f4afd84b21): created successfully Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ba75bb-6248-45e5-ba7f-4058fcb4b78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (aab49c08-7b54-4979-979a-fbb960c6c828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:39 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d06614d1-5cf8-43c7-aaa1-e58de7ecfbc4 tempest-CreateVolumesFromImageTest-876858461 None] Created volume successfully. Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "cinder-33b2464c-bda0-437c-9679-db4629e457f8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:40 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-33b2464c-bda0-437c-9679-db4629e457f8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f 1073741824" returned: 0 in 0.996s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "cinder-quobyte-33b2464c-bda0-437c-9679-db4629e457f8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:40 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f Jul 29 16:14:40 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-quobyte-33b2464c-bda0-437c-9679-db4629e457f8" acquired by "delete_volume" :: waited 0.108s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfebee8-b7c9-4fdd-8d16-1c4439bcd917]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:40 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 Jul 29 16:14:40 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:40 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f" returned: 0 in 0.551s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.601s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1083038381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5904bc86-a945-4e51-a704-e15db4b21c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90c9f59268412e9c89696bfff3a896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:14:37Z,use_quota=True,user_id='8e757b67e12f4e20914bfd1a464d5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Creating volume 5904bc86-a945-4e51-a704-e15db4b21c3a {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:14:40 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:40 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a 1073741824 Jul 29 16:14:40 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dd73ac-d0d2-4c01-99f4-3ee0db1e437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23f83b7-69b6-4c85-8442-2dd91254fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Volume volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f (bde7bcc8-1c85-4048-85d6-7a4cd123ab1f): created successfully Jul 29 16:14:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23f83b7-69b6-4c85-8442-2dd91254fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (ca46e6e9-8059-4102-8917-b2ef90fcc98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b9c34ed4-146f-49b7-94b7-112688b0c9e8 tempest-CreateVolumesFromImageTest-876858461 None] Created volume successfully. Jul 29 16:14:41 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8" returned: 0 in 1.082s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:41 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8 Jul 29 16:14:41 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:41 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a 1073741824" returned: 0 in 1.064s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:42 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a Jul 29 16:14:42 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:42 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-33b2464c-bda0-437c-9679-db4629e457f8" returned: 0 in 0.635s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-quobyte-33b2464c-bda0-437c-9679-db4629e457f8" released by "delete_volume" :: held 1.870s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:42 devstack cinder-volume[88575]: WARNING cinder.quota [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2028731298-234748728 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2028731298-234748728, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:42 devstack cinder-volume[88575]: WARNING cinder.quota [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2028731298-234748728 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2028731298-234748728, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Created reservations ['99b39afe-f5c9-4bb3-9c14-f1befa9015b5', '5bcd2f0c-abd5-4a9b-9fc0-d1ea96b021d4', 'da971a60-e5f0-49e0-8c20-551f0039ff60', '13a51bf7-84cf-4ed6-ac70-aee3f5d1fb92'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:42 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a" returned: 0 in 0.554s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:42 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:42 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e309e2-76db-4d1e-8827-d14dc6ddffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5904bc86-a945-4e51-a704-e15db4b21c3a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63cb12d-152b-4d25-bf41-292b48e0d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:14:42 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Volume volume-5904bc86-a945-4e51-a704-e15db4b21c3a (5904bc86-a945-4e51-a704-e15db4b21c3a): created successfully Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63cb12d-152b-4d25-bf41-292b48e0d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Flow 'volume_create_manager' (67414e27-83bb-48d0-9b1b-a101bd0f00f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:14:42 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0ee59436-6684-44ef-85e6-0d345551e724 tempest-CreateVolumesFromImageTest-876858461 None] Created volume successfully. Jul 29 16:14:42 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:42 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Deleted volume successfully. Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-49d935eb-5a6a-4753-9d56-994d7c6ddbb9 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-33b2464c-bda0-437c-9679-db4629e457f8-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-5904bc86-a945-4e51-a704-e15db4b21c3a-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-5904bc86-a945-4e51-a704-e15db4b21c3a-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-quobyte-5904bc86-a945-4e51-a704-e15db4b21c3a" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-5904bc86-a945-4e51-a704-e15db4b21c3a" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768e476-cb79-41de-a8e4-20563e28df1b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:43 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a Jul 29 16:14:43 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:44 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a" returned: 0 in 0.588s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:44 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a Jul 29 16:14:44 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:44 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5904bc86-a945-4e51-a704-e15db4b21c3a" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-5904bc86-a945-4e51-a704-e15db4b21c3a" released by "delete_volume" :: held 1.067s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Created reservations ['4239916a-115b-46aa-9671-dd8dd275fddd', '17e0c4c5-b5d0-461b-a044-5e27af8af2a3', '732edc59-9029-47d4-92d8-7811aee03243', '0d98b26d-e08f-4035-9bbf-ad520bc4bd70'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:44 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:44 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:45 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Deleted volume successfully. Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ca537e4e-eabe-4d42-8aa1-ac896f72be6c tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-5904bc86-a945-4e51-a704-e15db4b21c3a-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-quobyte-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f" acquired by "delete_volume" :: waited 0.047s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89028b9-1ec8-43ee-a8d1-dc2d0048c4e2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:45 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f Jul 29 16:14:45 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:46 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f" returned: 0 in 0.597s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:46 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f Jul 29 16:14:46 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-676331c6-06cb-46dc-9304-33b7caf2469d req-0c4e5825-a8c0-4d85-a002-6352c5b99f91 tempest-TestInstancesWithCinderVolumes-716812905 None] Terminate volume connection completed successfully. Jul 29 16:14:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-676331c6-06cb-46dc-9304-33b7caf2469d req-0c4e5825-a8c0-4d85-a002-6352c5b99f91 tempest-TestInstancesWithCinderVolumes-716812905 None] Deleting attachment 1d2f111e-9b08-43c9-869c-c4384cd604e5. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:14:46 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f" returned: 0 in 0.439s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f" released by "delete_volume" :: held 1.128s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Created reservations ['a5a48493-ef96-4d27-bb0a-1482abc579b4', '82bd6c41-973c-4caa-bf5a-a99b2bc0d4a3', '80027953-8b17-4170-8b94-e77f27aacf7e', 'd9d2e66c-dd32-44d4-9fcf-ff7b49a84553'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:47 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:47 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:47 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.459s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Deleted volume successfully. Jul 29 16:14:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a8141811-ca85-4e7a-b0f1-46a63664033e tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-bde7bcc8-1c85-4048-85d6-7a4cd123ab1f-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "cinder-9da00ef0-8c02-4770-8842-222f098db712-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-9da00ef0-8c02-4770-8842-222f098db712-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "cinder-quobyte-9da00ef0-8c02-4770-8842-222f098db712" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-quobyte-9da00ef0-8c02-4770-8842-222f098db712" acquired by "delete_volume" :: waited 0.039s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-quobyte-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c07681-e080-4183-a1a1-f837581601c7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21" acquired by "delete_volume" :: waited 0.051s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d8d34-17fe-46df-8ca0-466f464738eb]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:48 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 Jul 29 16:14:48 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:48 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 Jul 29 16:14:48 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:49 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21" returned: 0 in 0.669s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:49 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21 Jul 29 16:14:49 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:49 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712" returned: 0 in 0.809s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:49 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712 Jul 29 16:14:49 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:49 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9da00ef0-8c02-4770-8842-222f098db712" returned: 0 in 0.430s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-quobyte-9da00ef0-8c02-4770-8842-222f098db712" released by "delete_volume" :: held 1.368s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:49 devstack cinder-volume[88575]: WARNING cinder.quota [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1464476987-555075826 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1464476987-555075826, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:49 devstack cinder-volume[88575]: WARNING cinder.quota [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1464476987-555075826 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1464476987-555075826, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:49 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21" returned: 0 in 0.796s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Created reservations ['cea43a0b-0a9c-40d1-a276-528120a1f214', '4ae682e9-c9df-4bea-841f-231a851c970d', 'bfe36168-e798-4af9-8d46-ad6ab0bd8071', '624f1436-6a4e-4d55-af67-74cfbecc994c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21" released by "delete_volume" :: held 1.543s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:50 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:50 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Created reservations ['dad2cfe0-0cfa-4632-aec6-b46da5dbd4fb', '69e54bb9-4d53-4a96-81b5-3f8cae3ca69e', '843d8d3c-ff5e-4823-8432-9e19d48121a9', '8637dcd9-c66d-42f6-aadb-3d4f4452b2af'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:50 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:50 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:50 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.620s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Deleted volume successfully. Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78e84d68-4eee-44ff-9c3c-54b61069cbfe tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-9da00ef0-8c02-4770-8842-222f098db712-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-9e36db53-c560-4a92-8717-7962432cd199-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-9e36db53-c560-4a92-8717-7962432cd199-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-quobyte-9e36db53-c560-4a92-8717-7962432cd199" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-9e36db53-c560-4a92-8717-7962432cd199" acquired by "delete_volume" :: waited 0.060s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab3b979-fec8-4300-92eb-59dfdffdbd19]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:51 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.756s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Deleted volume successfully. Jul 29 16:14:51 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 Jul 29 16:14:51 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-290d787a-9f2a-444e-86a3-1c1669c4a6de tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-9fb4a022-89a7-4f13-9ceb-c5f4afd84b21-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:51 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199" returned: 0 in 0.523s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:51 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199 Jul 29 16:14:51 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:52 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9e36db53-c560-4a92-8717-7962432cd199" returned: 0 in 0.360s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-9e36db53-c560-4a92-8717-7962432cd199" released by "delete_volume" :: held 0.934s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Created reservations ['1fe5390c-a587-40d1-b583-60f0820cbcbd', '7e9012c7-e519-48e4-8734-ac0369a455cb', '4f138c43-905b-4b74-a1e8-1ce8a296ef4d', '7437b8d1-a462-470b-8be3-e47e6a93eb45'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:52 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:52 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-8ed26838-4d01-4f2e-be1f-60bdd07064bb-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-8ed26838-4d01-4f2e-be1f-60bdd07064bb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "cinder-quobyte-8ed26838-4d01-4f2e-be1f-60bdd07064bb" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-8ed26838-4d01-4f2e-be1f-60bdd07064bb" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e8888e-5184-4b54-8036-128a01bd4363]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:52 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.416s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Deleted volume successfully. Jul 29 16:14:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-96780917-dd17-456c-8ba5-1ee7ba2feb81 tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-9e36db53-c560-4a92-8717-7962432cd199-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:52 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb Jul 29 16:14:52 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:53 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb" returned: 0 in 0.652s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:53 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb Jul 29 16:14:53 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:53 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8ed26838-4d01-4f2e-be1f-60bdd07064bb" returned: 0 in 0.548s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-quobyte-8ed26838-4d01-4f2e-be1f-60bdd07064bb" released by "delete_volume" :: held 1.294s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:53 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Created reservations ['8224dd9f-6dc6-4883-bfce-d17fdc06c68b', 'e93e52f8-82f6-425f-92bf-4f4715e718d1', 'a9f42548-ad55-44d5-8aa7-6f14f6f007a9', '3e4d0ab8-aba1-49c0-bc9d-d18675c3e4c9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:54 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:14:54 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:54 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.442s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:14:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Deleted volume successfully. Jul 29 16:14:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-be5b4861-c5f7-4ece-bc9a-abe6901caaed tempest-CreateVolumesFromImageTest-876858461 None] Lock "cinder-8ed26838-4d01-4f2e-be1f-60bdd07064bb-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-1dfe8051-c87d-471e-816c-f44d3b32530e req-63f62036-c9ec-4efd-a3d4-a8d0a72281b2 tempest-TestInstancesWithCinderVolumes-716812905 None] Terminate volume connection completed successfully. Jul 29 16:14:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-1dfe8051-c87d-471e-816c-f44d3b32530e req-63f62036-c9ec-4efd-a3d4-a8d0a72281b2 tempest-TestInstancesWithCinderVolumes-716812905 None] Deleting attachment e1f36f6f-b7e5-452f-8369-c1db789ba897. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:14:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "cinder-db136a2f-7675-4c35-8efe-55e0796ea9be-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-db136a2f-7675-4c35-8efe-55e0796ea9be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "cinder-quobyte-db136a2f-7675-4c35-8efe-55e0796ea9be" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:14:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-quobyte-db136a2f-7675-4c35-8efe-55e0796ea9be" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:14:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be4acc3-e8fa-4dd6-965e-901b51f11c05]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:14:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:59 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be Jul 29 16:14:59 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:59 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be" returned: 0 in 0.436s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:14:59 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be Jul 29 16:14:59 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:14:59 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 29 16:14:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db136a2f-7675-4c35-8efe-55e0796ea9be" returned: 0 in 0.329s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:14:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-quobyte-db136a2f-7675-4c35-8efe-55e0796ea9be" released by "delete_volume" :: held 0.824s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:14:59 devstack cinder-volume[88575]: WARNING cinder.quota [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985933253-1133992192 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985933253-1133992192, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:59 devstack cinder-volume[88575]: WARNING cinder.quota [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985933253-1133992192 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-985933253-1133992192, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:14:59 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Created reservations ['e8e97a2a-6c3e-4a59-b0dc-75804751d6fe', 'e384e884-8996-4f58-a0af-cf46c6715c81', '9bb7774d-2bd1-4b89-99e3-ad22279c3bf4', '4a41be5c-195f-409c-8e44-55f7a0efa3d4'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:00 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:15:00 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:00 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.353s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:15:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Deleted volume successfully. Jul 29 16:15:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6883b96f-4430-486e-a721-84ae07aefc28 tempest-TestInstancesWithCinderVolumes-716812905 None] Lock "cinder-db136a2f-7675-4c35-8efe-55e0796ea9be-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Flow 'volume_create_manager' (2fde0134-a51d-416c-800f-22f333973a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce1a268-3b4c-4b39-94d9-0bafbd4dfaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce1a268-3b4c-4b39-94d9-0bafbd4dfaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793801629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521f09df-3825-4d98-b779-922bc21498c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af65aaff9de14fab817e7a6104bc4683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:01Z,use_quota=True,user_id='6b5e35d76b9849a0ad2d953343a8d3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3684376e-3873-41f0-91dd-77678a1e0150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3684376e-3873-41f0-91dd-77678a1e0150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392cc82c-c7b3-4ab3-bd6d-eb83e66e37ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392cc82c-c7b3-4ab3-bd6d-eb83e66e37ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521f09df-3825-4d98-b779-922bc21498c3', 'volume_name': 'volume-521f09df-3825-4d98-b779-922bc21498c3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d3a966-2ce9-4813-8b08-e6d0cf3a734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d3a966-2ce9-4813-8b08-e6d0cf3a734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e06fe8-34a1-486b-9d78-a988a20ea109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Volume 521f09df-3825-4d98-b779-922bc21498c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521f09df-3825-4d98-b779-922bc21498c3', 'volume_size': 1} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793801629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521f09df-3825-4d98-b779-922bc21498c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af65aaff9de14fab817e7a6104bc4683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:01Z,use_quota=True,user_id='6b5e35d76b9849a0ad2d953343a8d3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Creating volume 521f09df-3825-4d98-b779-922bc21498c3 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:15:01 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:01 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 1073741824 Jul 29 16:15:01 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:01 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 1073741824" returned: 0 in 0.544s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:01 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 Jul 29 16:15:01 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:02 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3" returned: 0 in 0.355s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e06fe8-34a1-486b-9d78-a988a20ea109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521f09df-3825-4d98-b779-922bc21498c3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73da0dbc-aa8c-4902-acb5-53809fc7f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:02 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Volume volume-521f09df-3825-4d98-b779-922bc21498c3 (521f09df-3825-4d98-b779-922bc21498c3): created successfully Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73da0dbc-aa8c-4902-acb5-53809fc7f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Flow 'volume_create_manager' (2fde0134-a51d-416c-800f-22f333973a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7b6988f8-cc14-4332-8703-c27dea47afe6 tempest-ProjectReaderTests-1041807492 None] Created volume successfully. Jul 29 16:15:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Acquiring lock "cinder-521f09df-3825-4d98-b779-922bc21498c3-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:15:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Lock "cinder-521f09df-3825-4d98-b779-922bc21498c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:15:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Acquiring lock "cinder-quobyte-521f09df-3825-4d98-b779-922bc21498c3" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:15:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Lock "cinder-quobyte-521f09df-3825-4d98-b779-922bc21498c3" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:15:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c17c50-bd2e-4f23-803c-e9b1e210a66d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:15:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:04 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 Jul 29 16:15:04 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:04 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3" returned: 0 in 0.532s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:04 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3 Jul 29 16:15:04 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:04 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-521f09df-3825-4d98-b779-922bc21498c3" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Lock "cinder-quobyte-521f09df-3825-4d98-b779-922bc21498c3" released by "delete_volume" :: held 1.060s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Created reservations ['9bf812b4-e0b6-4df1-b7c4-1b7e34a47afb', 'fd3985b9-4afe-4c22-964e-10634e35318e', '8d028e52-3aaf-4d9f-8ee5-3e92beabc783', '91ff0642-2130-432a-8e5b-b7e765be663d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:05 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:15:05 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:05 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.363s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:05 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:15:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Deleted volume successfully. Jul 29 16:15:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d92bf1a0-1869-4384-8d1e-e65c335ac34d tempest-ProjectReaderTests-1041807492 None] Lock "cinder-521f09df-3825-4d98-b779-922bc21498c3-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Flow 'volume_create_manager' (fc0befe0-ad4d-4474-b534-06b356cc8eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ea8b26-b343-467c-b0f4-8ed71ca45f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ea8b26-b343-467c-b0f4-8ed71ca45f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258118013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1866e9cc-6214-450e-8144-48e7875326c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af65aaff9de14fab817e7a6104bc4683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:07Z,use_quota=True,user_id='6b5e35d76b9849a0ad2d953343a8d3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cbf0c8-6585-46eb-9470-9380fb9d978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cbf0c8-6585-46eb-9470-9380fb9d978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d8d4b8-fd83-48ed-b3e9-1cbd5ba9458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d8d4b8-fd83-48ed-b3e9-1cbd5ba9458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1866e9cc-6214-450e-8144-48e7875326c7', 'volume_name': 'volume-1866e9cc-6214-450e-8144-48e7875326c7', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9f55d-3d3d-4c52-8c75-b425e8342f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9f55d-3d3d-4c52-8c75-b425e8342f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2b296e-db34-4ade-9736-f1fde98a8c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:06 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Volume 1866e9cc-6214-450e-8144-48e7875326c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1866e9cc-6214-450e-8144-48e7875326c7', 'volume_size': 1} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258118013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1866e9cc-6214-450e-8144-48e7875326c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af65aaff9de14fab817e7a6104bc4683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:07Z,use_quota=True,user_id='6b5e35d76b9849a0ad2d953343a8d3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Creating volume 1866e9cc-6214-450e-8144-48e7875326c7 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:15:06 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:15:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:06 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 1073741824 Jul 29 16:15:06 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:07 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 1073741824" returned: 0 in 0.776s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:07 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 Jul 29 16:15:07 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Flow 'volume_create_manager' (62439ca4-52cb-4cf7-a321-918e610413dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96df606-7113-4261-9305-95b783123ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96df606-7113-4261-9305-95b783123ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-295445085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7f6a0995b4cae9fe63fa2fa8cbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:08Z,use_quota=True,user_id='10962c7a118e40f4ac91cc06693f8b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb62beb-f444-43cf-a58b-e9aa3cb89640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb62beb-f444-43cf-a58b-e9aa3cb89640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de202cd5-6ed8-4f2b-a752-ad86f58ced09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de202cd5-6ed8-4f2b-a752-ad86f58ced09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0', 'volume_name': 'volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004e6ecd-a608-461f-aae5-f084a2dbc5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004e6ecd-a608-461f-aae5-f084a2dbc5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aca1c0-0fc1-4bc7-94f9-6ed097bb0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Volume f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0', 'volume_size': 1} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:07 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7" returned: 0 in 0.325s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-295445085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7f6a0995b4cae9fe63fa2fa8cbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:08Z,use_quota=True,user_id='10962c7a118e40f4ac91cc06693f8b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Creating volume f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:15:07 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2b296e-db34-4ade-9736-f1fde98a8c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1866e9cc-6214-450e-8144-48e7875326c7', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780c0ae4-c226-42d0-bc54-136af2865281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:07 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 1073741824 Jul 29 16:15:07 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Volume volume-1866e9cc-6214-450e-8144-48e7875326c7 (1866e9cc-6214-450e-8144-48e7875326c7): created successfully Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780c0ae4-c226-42d0-bc54-136af2865281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Flow 'volume_create_manager' (fc0befe0-ad4d-4474-b534-06b356cc8eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cb29e252-0c77-4369-ae23-0e37d93640c8 tempest-ProjectReaderTests-1041807492 None] Created volume successfully. Jul 29 16:15:08 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 1073741824" returned: 0 in 0.556s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:08 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 Jul 29 16:15:08 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:08 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "cinder-1866e9cc-6214-450e-8144-48e7875326c7-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aca1c0-0fc1-4bc7-94f9-6ed097bb0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef15c13-04ad-4091-9be7-014d53411e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Lock "cinder-1866e9cc-6214-450e-8144-48e7875326c7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:15:09 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Volume volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 (f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0): created successfully Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef15c13-04ad-4091-9be7-014d53411e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Flow 'volume_create_manager' (62439ca4-52cb-4cf7-a321-918e610413dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-eae66a1f-055e-4db6-b7c8-470d1c0cfa7a tempest-AttachVolumeNegativeTest-240557135 None] Created volume successfully. Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "cinder-quobyte-1866e9cc-6214-450e-8144-48e7875326c7" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Lock "cinder-quobyte-1866e9cc-6214-450e-8144-48e7875326c7" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78503f3-414d-4a49-8e38-f9870a21c76a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:09 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 Jul 29 16:15:09 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:09 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7" returned: 0 in 0.525s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:09 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7 Jul 29 16:15:09 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:10 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1866e9cc-6214-450e-8144-48e7875326c7" returned: 0 in 0.412s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Lock "cinder-quobyte-1866e9cc-6214-450e-8144-48e7875326c7" released by "delete_volume" :: held 1.019s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Created reservations ['35beeb2b-551c-46e0-bb07-2a5e570f0632', '93ca342e-4354-4627-ac70-f1e3e0ce2a76', 'b5005166-660b-4bc0-9e6d-ccd2a1c7d95d', '400206f8-6a8f-4192-bb8b-bfb8bf59c0ab'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:10 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:15:10 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:10 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.550s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:15:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Deleted volume successfully. Jul 29 16:15:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac5e7fdf-46d8-40b6-9b39-f66c5e875151 tempest-ProjectReaderTests-1041807492 None] Lock "cinder-1866e9cc-6214-450e-8144-48e7875326c7-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-84ebab83-5d68-4dd5-adcd-6d86f03dc8d8 req-2ac39028-3f63-4c92-b29e-f0a7e31ba1cf tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-84ebab83-5d68-4dd5-adcd-6d86f03dc8d8 req-2ac39028-3f63-4c92-b29e-f0a7e31ba1cf tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-84ebab83-5d68-4dd5-adcd-6d86f03dc8d8 req-2ac39028-3f63-4c92-b29e-f0a7e31ba1cf tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-84ebab83-5d68-4dd5-adcd-6d86f03dc8d8 req-2ac39028-3f63-4c92-b29e-f0a7e31ba1cf tempest-AttachVolumeNegativeTest-240557135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '220d7b63-3c9f-42f5-b48e-30f40f5e78aa', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:15:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-84ebab83-5d68-4dd5-adcd-6d86f03dc8d8 req-2ac39028-3f63-4c92-b29e-f0a7e31ba1cf tempest-AttachVolumeNegativeTest-240557135 None] attachment_update completed successfully. Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=114,cinder:INSERT=33,cinder:UPDATE=130,cinder:DELETE=8 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=129,cinder:SELECT=102,cinder:INSERT=34,cinder:DELETE=13 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Flow 'volume_create_manager' (805ebb73-6a75-40f5-ac70-d9585cbbe194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a859b6-8f75-4925-9bfc-da7e895289b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a859b6-8f75-4925-9bfc-da7e895289b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2138449846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fec9d34-3ee0-464e-9800-2c9caf080f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2938d474e54513ba71e4858c7e6df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:16Z,use_quota=True,user_id='5036403ccb974badabea61d67fc489eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63a800c-0cac-4a94-9147-e0615178ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63a800c-0cac-4a94-9147-e0615178ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece67ef4-ebdd-4620-80ba-00792e038713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece67ef4-ebdd-4620-80ba-00792e038713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fec9d34-3ee0-464e-9800-2c9caf080f13', 'volume_name': 'volume-2fec9d34-3ee0-464e-9800-2c9caf080f13', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839b1e52-f448-42f4-a3a6-f6846ca96405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839b1e52-f448-42f4-a3a6-f6846ca96405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91456964-cea7-43cc-b4a0-7a580186bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Volume 2fec9d34-3ee0-464e-9800-2c9caf080f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fec9d34-3ee0-464e-9800-2c9caf080f13', 'volume_size': 1} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2138449846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fec9d34-3ee0-464e-9800-2c9caf080f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2938d474e54513ba71e4858c7e6df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:15:16Z,use_quota=True,user_id='5036403ccb974badabea61d67fc489eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Creating volume 2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:15:15 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:15:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:16 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 1073741824 Jul 29 16:15:16 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:16 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 1073741824" returned: 0 in 0.743s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:16 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 Jul 29 16:15:16 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:17 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91456964-cea7-43cc-b4a0-7a580186bd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fec9d34-3ee0-464e-9800-2c9caf080f13', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4372b-7d3b-48cd-8b20-43f6b7ae2ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:15:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Volume volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 (2fec9d34-3ee0-464e-9800-2c9caf080f13): created successfully Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4372b-7d3b-48cd-8b20-43f6b7ae2ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:15:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Flow 'volume_create_manager' (805ebb73-6a75-40f5-ac70-d9585cbbe194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:15:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0bc2ba70-0f04-4589-bac0-96249fb467a0 tempest-TestImageHashVerification-1481591105 None] Created volume successfully. Jul 29 16:15:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[922acca2-3500-4b26-91a8-3032dd80c763]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:15:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:19 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 Jul 29 16:15:19 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:20 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13" returned: 0 in 0.498s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:20 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff6653e-f5d2-4905-ac87-30a7f10c8169]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:15:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:20 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 Jul 29 16:15:20 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:20 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13" returned: 0 in 0.500s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 /opt/stack/data/cinder/conversion/2fec9d34-3ee0-464e-9800-2c9caf080f13.temp_image.919c0181-45b6-4aa0-84ee-26c77098e80f0wojoy3q.img {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:20 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 /opt/stack/data/cinder/conversion/2fec9d34-3ee0-464e-9800-2c9caf080f13.temp_image.919c0181-45b6-4aa0-84ee-26c77098e80f0wojoy3q.img Jul 29 16:15:20 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:26 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 /opt/stack/data/cinder/conversion/2fec9d34-3ee0-464e-9800-2c9caf080f13.temp_image.919c0181-45b6-4aa0-84ee-26c77098e80f0wojoy3q.img" returned: 0 in 5.701s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:26 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd90f8-f953-4844-9ed5-152bc2639961]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:15:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:26 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 Jul 29 16:15:26 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:26 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13" returned: 0 in 0.657s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:26 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/conversion/2fec9d34-3ee0-464e-9800-2c9caf080f13.temp_image.919c0181-45b6-4aa0-84ee-26c77098e80f0wojoy3q.img {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:15:26 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Converted 1024.00 MB image at 179.52 MB/s Jul 29 16:15:26 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] 919c0181-45b6-4aa0-84ee-26c77098e80f was raw, no need to convert to raw {{(pid=88575) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:36 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:15:36 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:37 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:15:46 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:15:46 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:15:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.066s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Uploaded volume to glance image-id: 919c0181-45b6-4aa0-84ee-26c77098e80f. {{(pid=88575) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 29 16:15:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1fed43c6-f555-4ed3-a831-858b937964b6 tempest-TestImageHashVerification-1481591105 None] Copy volume to image completed successfully. Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Acquiring lock "cinder-2fec9d34-3ee0-464e-9800-2c9caf080f13-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Lock "cinder-2fec9d34-3ee0-464e-9800-2c9caf080f13-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Acquiring lock "cinder-quobyte-2fec9d34-3ee0-464e-9800-2c9caf080f13" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Lock "cinder-quobyte-2fec9d34-3ee0-464e-9800-2c9caf080f13" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc6d70-70e1-41d8-a6e8-474fd98da05d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:55 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 Jul 29 16:15:55 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:55 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13" returned: 0 in 0.465s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:55 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13 Jul 29 16:15:55 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:56 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2fec9d34-3ee0-464e-9800-2c9caf080f13" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Lock "cinder-quobyte-2fec9d34-3ee0-464e-9800-2c9caf080f13" released by "delete_volume" :: held 0.824s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Created reservations ['840172a3-f961-4062-901a-aa13fceca10d', '71c69ca0-ae7e-4459-9a07-7e97d53a4580', '53c633de-13a0-486d-bf83-b5ed66601dc6', '7e15dc12-60e7-4b3d-bc18-0cb94d4372d0'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:15:56 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:15:56 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:15:56 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.332s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:15:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Deleted volume successfully. Jul 29 16:15:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c4376e39-ab12-4271-b5b6-8da0686b77a4 tempest-TestImageHashVerification-1481591105 None] Lock "cinder-2fec9d34-3ee0-464e-9800-2c9caf080f13-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:15:58 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-f5de8d57-b3e8-49c3-b6a5-ef2665e10dd1 req-47a5c7d5-2673-4aa3-9b3a-81fb4131d376 tempest-AttachVolumeNegativeTest-240557135 None] Terminate volume connection completed successfully. Jul 29 16:15:58 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-f5de8d57-b3e8-49c3-b6a5-ef2665e10dd1 req-47a5c7d5-2673-4aa3-9b3a-81fb4131d376 tempest-AttachVolumeNegativeTest-240557135 None] Deleting attachment 220d7b63-3c9f-42f5-b48e-30f40f5e78aa. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:16:06 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:16:08 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:16:13 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (6a12f6b8-f23d-4996-8d2a-51fe3b0eb4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d5e9a-a0a0-4e00-a4b8-755e6b762009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d5e9a-a0a0-4e00-a4b8-755e6b762009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241247505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d2d426-3d10-449b-89f1-e4318481ae55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:14Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cb5403-ee0d-4ab4-8ed7-3fb4db0d3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cb5403-ee0d-4ab4-8ed7-3fb4db0d3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0cc7eb-7928-4c86-bea1-1f54a7f81430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0cc7eb-7928-4c86-bea1-1f54a7f81430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d2d426-3d10-449b-89f1-e4318481ae55', 'volume_name': 'volume-e2d2d426-3d10-449b-89f1-e4318481ae55', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93e79e0-262c-4106-b26b-2cad4f5a7c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93e79e0-262c-4106-b26b-2cad4f5a7c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a743dd6-20eb-4cda-9198-2d9c494c0444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume e2d2d426-3d10-449b-89f1-e4318481ae55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d2d426-3d10-449b-89f1-e4318481ae55', 'volume_size': 1} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241247505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d2d426-3d10-449b-89f1-e4318481ae55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:14Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating volume e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:14 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:14 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 1073741824 Jul 29 16:16:14 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:14 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 1073741824" returned: 0 in 0.735s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:14 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 Jul 29 16:16:14 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:15 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a743dd6-20eb-4cda-9198-2d9c494c0444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d2d426-3d10-449b-89f1-e4318481ae55', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f67daf-11fb-436b-8b8c-7a4af6c8a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume volume-e2d2d426-3d10-449b-89f1-e4318481ae55 (e2d2d426-3d10-449b-89f1-e4318481ae55): created successfully Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f67daf-11fb-436b-8b8c-7a4af6c8a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (6a12f6b8-f23d-4996-8d2a-51fe3b0eb4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9b1aba0f-c432-4c38-a46c-339309701281 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created volume successfully. Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating offline snapshot 4e2e49e1-560b-4d11-aad4-f680f7fb31f6 of volume e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e356f-d87f-4011-a986-4520eac8079d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:16 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 Jul 29 16:16:16 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:16 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55" returned: 0 in 0.403s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:16 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 1G Jul 29 16:16:16 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:17 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 1G" returned: 0 in 0.865s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d2d426-3d10-449b-89f1-e4318481ae55 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:17 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d2d426-3d10-449b-89f1-e4318481ae55 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 Jul 29 16:16:17 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:18 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d2d426-3d10-449b-89f1-e4318481ae55 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6" returned: 0 in 0.697s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:18 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 is being set with open permissions: ugo+rw Jul 29 16:16:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:18 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 Jul 29 16:16:18 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:18 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6" returned: 0 in 0.607s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:19 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info Jul 29 16:16:19 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:19 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info" returned: 0 in 0.314s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:19 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info is being set with open permissions: ugo+rw Jul 29 16:16:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:19 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info Jul 29 16:16:19 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:19 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.info" returned: 0 in 0.267s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.278s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-87b22ec3-ac6a-4bac-a83a-331f15d005a6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Create snapshot completed successfully Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (2b2b60f8-5fa1-41fd-b1cb-fe935a14c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02273dd2-3d42-4e6e-8d58-bf6d599b221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02273dd2-3d42-4e6e-8d58-bf6d599b221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-197561726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540e69aa-64cd-406e-940d-e7386ff59cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:21Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2287b22b-0895-436a-868d-787fa1365e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2287b22b-0895-436a-868d-787fa1365e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0724e714-5e49-40e3-839b-cf644b2efbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0724e714-5e49-40e3-839b-cf644b2efbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540e69aa-64cd-406e-940d-e7386ff59cf6', 'volume_name': 'volume-540e69aa-64cd-406e-940d-e7386ff59cf6', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1914ec-ff8b-4fd5-827a-ff4dce6d90ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1914ec-ff8b-4fd5-827a-ff4dce6d90ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf457c4-1ce2-41c1-90b0-b006de26c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume 540e69aa-64cd-406e-940d-e7386ff59cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540e69aa-64cd-406e-940d-e7386ff59cf6', 'volume_size': 1} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-197561726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540e69aa-64cd-406e-940d-e7386ff59cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:21Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating volume 540e69aa-64cd-406e-940d-e7386ff59cf6 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:21 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:21 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 1073741824 Jul 29 16:16:21 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (89c6511f-b40b-4e76-9b37-ee7be085fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96b8647-c01a-4db1-8a3a-4f66ca93d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96b8647-c01a-4db1-8a3a-4f66ca93d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153139585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf385b2-f03b-4739-9b8e-75501d4ba4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:22Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fbd9ea-873b-4e03-a492-995a1564e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fbd9ea-873b-4e03-a492-995a1564e8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fc574a-a693-4fbe-a1fc-da310acaf940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fc574a-a693-4fbe-a1fc-da310acaf940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf385b2-f03b-4739-9b8e-75501d4ba4aa', 'volume_name': 'volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9a66fd-9353-414d-b194-f33fde0f3751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9a66fd-9353-414d-b194-f33fde0f3751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7c593d-bd3f-41b8-afe4-b172b307d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume 6cf385b2-f03b-4739-9b8e-75501d4ba4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa', 'volume_size': 1} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:22 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 1073741824" returned: 0 in 0.767s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:22 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 Jul 29 16:16:22 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:22 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6" returned: 0 in 0.385s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153139585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf385b2-f03b-4739-9b8e-75501d4ba4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:22Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating volume 6cf385b2-f03b-4739-9b8e-75501d4ba4aa {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:22 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:22 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa 1073741824 Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (f1c16be3-3bd2-44bd-afa9-41aae40f1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:22 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2d3db5-a5ad-48d0-96e1-3ab1ae41b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf457c4-1ce2-41c1-90b0-b006de26c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540e69aa-64cd-406e-940d-e7386ff59cf6', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a6efbc-4115-4363-be74-4a7e876abb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2d3db5-a5ad-48d0-96e1-3ab1ae41b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906936505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:23Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f48c6f-ed69-4232-825b-8edf09abacd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f48c6f-ed69-4232-825b-8edf09abacd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571e5f72-8f48-4625-9f1f-c3b9278df812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571e5f72-8f48-4625-9f1f-c3b9278df812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4', 'volume_name': 'volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2702fee6-b957-4a65-a61b-1191ad39941a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2702fee6-b957-4a65-a61b-1191ad39941a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6762c21-90f7-4537-b619-17bc278a685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4', 'volume_size': 1} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume volume-540e69aa-64cd-406e-940d-e7386ff59cf6 (540e69aa-64cd-406e-940d-e7386ff59cf6): created successfully Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a6efbc-4115-4363-be74-4a7e876abb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (2b2b60f8-5fa1-41fd-b1cb-fe935a14c077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-906a2b2f-fc0b-41df-bde4-1c82ed6cbba6 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created volume successfully. Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (17c3db60-f508-4c19-8548-c112e64aeadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4559dd0-e1ea-479e-8ff9-d11c5caf449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4559dd0-e1ea-479e-8ff9-d11c5caf449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40166939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9573cf40-1d9f-44c2-89b4-aaefbd273657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:23Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0760d1-0be4-4472-8515-a34b4a755184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0760d1-0be4-4472-8515-a34b4a755184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef0f892-e150-4bd2-983e-b7e36f1e9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef0f892-e150-4bd2-983e-b7e36f1e9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9573cf40-1d9f-44c2-89b4-aaefbd273657', 'volume_name': 'volume-9573cf40-1d9f-44c2-89b4-aaefbd273657', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3f8473-1f41-4fed-b506-ab00aa3dd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3f8473-1f41-4fed-b506-ab00aa3dd8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f472d7-7a14-407d-a87a-c31a583d559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:23 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume 9573cf40-1d9f-44c2-89b4-aaefbd273657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9573cf40-1d9f-44c2-89b4-aaefbd273657', 'volume_size': 1} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa 1073741824" returned: 0 in 0.945s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:23 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:23 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa Jul 29 16:16:23 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:23 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa" returned: 0 in 0.365s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906936505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:23Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating volume d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:24 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:24 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 1073741824 Jul 29 16:16:24 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (4f2b81ce-813d-49de-83a5-c0245fb22b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48031783-a943-4fe7-904a-d3e4a03d8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7c593d-bd3f-41b8-afe4-b172b307d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de28f00-1efa-43b9-b927-cc007117432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48031783-a943-4fe7-904a-d3e4a03d8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1770310183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1697af49-0482-425c-a230-e3ddcaf2003c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:24Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3482e902-f248-489c-8b64-52bf6c22b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3482e902-f248-489c-8b64-52bf6c22b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d85fa-5f66-4480-a675-2a5ffe4933d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d85fa-5f66-4480-a675-2a5ffe4933d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1697af49-0482-425c-a230-e3ddcaf2003c', 'volume_name': 'volume-1697af49-0482-425c-a230-e3ddcaf2003c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6db8284-d440-4f0a-b264-40b1c55ddec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6db8284-d440-4f0a-b264-40b1c55ddec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55560115-2d50-4de4-b7b5-13d824d1b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume 1697af49-0482-425c-a230-e3ddcaf2003c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1697af49-0482-425c-a230-e3ddcaf2003c', 'volume_size': 1} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa (6cf385b2-f03b-4739-9b8e-75501d4ba4aa): created successfully Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de28f00-1efa-43b9-b927-cc007117432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (89c6511f-b40b-4e76-9b37-ee7be085fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3424c6bb-53f0-4b1f-b4ca-3b021d9aeb27 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created volume successfully. Jul 29 16:16:24 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 1073741824" returned: 0 in 0.600s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:24 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 Jul 29 16:16:24 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:25 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4" returned: 0 in 0.321s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40166939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9573cf40-1d9f-44c2-89b4-aaefbd273657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:23Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating volume 9573cf40-1d9f-44c2-89b4-aaefbd273657 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:25 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6762c21-90f7-4537-b619-17bc278a685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4544cd-a925-477e-919f-f7d973c07a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:25 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 1073741824 Jul 29 16:16:25 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:25 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 (d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4): created successfully Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4544cd-a925-477e-919f-f7d973c07a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (f1c16be3-3bd2-44bd-afa9-41aae40f1506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ddbede13-f9e4-4dcd-84d9-4cbbff81a2c5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created volume successfully. Jul 29 16:16:25 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 1073741824" returned: 0 in 0.486s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:25 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 Jul 29 16:16:25 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:25 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657" returned: 0 in 0.313s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1770310183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1697af49-0482-425c-a230-e3ddcaf2003c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7f4c0ddd24996817e5894772e1074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:24Z,use_quota=True,user_id='285831d3697b4f049bcc0a955946ce42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Creating volume 1697af49-0482-425c-a230-e3ddcaf2003c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:25 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f472d7-7a14-407d-a87a-c31a583d559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9573cf40-1d9f-44c2-89b4-aaefbd273657', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:25 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c 1073741824 Jul 29 16:16:25 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c02fd29-ceaf-4978-b47b-6997e7bece18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:25 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 (9573cf40-1d9f-44c2-89b4-aaefbd273657): created successfully Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c02fd29-ceaf-4978-b47b-6997e7bece18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (17c3db60-f508-4c19-8548-c112e64aeadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-96ea3b17-13a6-436e-b242-5d7c3142f823 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created volume successfully. Jul 29 16:16:26 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c 1073741824" returned: 0 in 0.593s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:26 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c Jul 29 16:16:26 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:26 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55560115-2d50-4de4-b7b5-13d824d1b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1697af49-0482-425c-a230-e3ddcaf2003c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45253407-172f-477d-92e4-e54a8d44da68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Volume volume-1697af49-0482-425c-a230-e3ddcaf2003c (1697af49-0482-425c-a230-e3ddcaf2003c): created successfully Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45253407-172f-477d-92e4-e54a8d44da68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Flow 'volume_create_manager' (4f2b81ce-813d-49de-83a5-c0245fb22b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d891481e-2a6f-45b1-b289-d2b051261055 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created volume successfully. Jul 29 16:16:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-1697af49-0482-425c-a230-e3ddcaf2003c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-1697af49-0482-425c-a230-e3ddcaf2003c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-1697af49-0482-425c-a230-e3ddcaf2003c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-1697af49-0482-425c-a230-e3ddcaf2003c" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b0941d-1c69-48de-a11c-501f1fe7f7e6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:27 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c Jul 29 16:16:27 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:28 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c" returned: 0 in 0.408s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:28 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c Jul 29 16:16:28 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:28 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1697af49-0482-425c-a230-e3ddcaf2003c" returned: 0 in 0.293s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-1697af49-0482-425c-a230-e3ddcaf2003c" released by "delete_volume" :: held 0.764s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['d849a88d-2f09-4f10-9168-2313a45f7446', 'e2dbd74f-f51c-49bf-a9b9-93f933a8a60a', 'c49191f5-e49b-4e45-85a8-e62aca43d1e6', '2738ba9f-06b4-4d48-a70c-b6f87456b48c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:28 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:28 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-9573cf40-1d9f-44c2-89b4-aaefbd273657-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-9573cf40-1d9f-44c2-89b4-aaefbd273657-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-9573cf40-1d9f-44c2-89b4-aaefbd273657" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-9573cf40-1d9f-44c2-89b4-aaefbd273657" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc876148-2fd9-446e-b3a7-2aec2a170da1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:28 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.322s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleted volume successfully. Jul 29 16:16:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7ff6db7-926e-4b3c-9f43-35bc638784e5 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-1697af49-0482-425c-a230-e3ddcaf2003c-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:28 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 Jul 29 16:16:28 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:29 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:29 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657 Jul 29 16:16:29 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:29 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9573cf40-1d9f-44c2-89b4-aaefbd273657" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-9573cf40-1d9f-44c2-89b4-aaefbd273657" released by "delete_volume" :: held 0.714s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['a1a352e2-9569-4f87-a5c1-880330554e1e', '60f12fff-5f09-4a5c-b346-164a26b5c82f', 'b78fa7e0-c4f9-49b0-97c4-4303357030fd', 'a9af383c-305d-4178-b749-dff26a445690'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:29 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:29 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:29 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleted volume successfully. Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4" acquired by "delete_volume" :: waited 0.040s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2cf351e2-44e0-4b20-bb02-b3cb1a081b66 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-9573cf40-1d9f-44c2-89b4-aaefbd273657-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646eee8-272d-46ff-95e2-3c8891c26fc5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:30 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 Jul 29 16:16:30 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:30 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4" returned: 0 in 0.366s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:30 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4 Jul 29 16:16:30 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:30 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4" released by "delete_volume" :: held 0.694s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['a93996c5-422a-4b4b-ace9-011992554935', '04bcec41-d712-403a-9320-d6d328e701ec', '602ae3a5-042f-4976-b581-ae6bc74e508a', 'be051716-1028-4707-97a4-685d0192ac52'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:30 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:30 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-6cf385b2-f03b-4739-9b8e-75501d4ba4aa-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:31 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-6cf385b2-f03b-4739-9b8e-75501d4ba4aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.359s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleted volume successfully. Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-6cf385b2-f03b-4739-9b8e-75501d4ba4aa" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0aaa93b7-c22b-4bec-992f-d8347b854b8f tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-d014e4e1-a4d7-4943-8f2e-28f5ac8ec8a4-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-6cf385b2-f03b-4739-9b8e-75501d4ba4aa" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9667a-dab5-4b4e-a7a3-879a04aa5ddb]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:31 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa Jul 29 16:16:31 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:31 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa" returned: 0 in 0.435s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:31 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa Jul 29 16:16:31 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:31 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6cf385b2-f03b-4739-9b8e-75501d4ba4aa" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-6cf385b2-f03b-4739-9b8e-75501d4ba4aa" released by "delete_volume" :: held 0.761s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:31 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['c552b055-7294-403e-9d89-b3af2f26c93b', '84f0b3fe-37d3-4baa-a8bd-f431887ce053', '703ce6d1-b52a-426e-9747-aed11920d077', 'b71e0731-5240-414b-a5ca-4caa3717073e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:32 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:32 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Flow 'volume_create_manager' (c88b2c5a-f81b-4c42-bc25-8416d7958763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6b46b2-bfed-4603-a4b4-f45b02e8e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6b46b2-bfed-4603-a4b4-f45b02e8e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1424578096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89e85f7-b086-427a-acc3-c51b127dfb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578c43b846d14449829acbf73e0cba1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:32Z,use_quota=True,user_id='0baeb2ebbbab476fb452d501f46ebe3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8b1005-0099-4e10-869d-4b6ee90ac134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8b1005-0099-4e10-869d-4b6ee90ac134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15363c85-7028-4425-a63a-57d314e4ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15363c85-7028-4425-a63a-57d314e4ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89e85f7-b086-427a-acc3-c51b127dfb44', 'volume_name': 'volume-c89e85f7-b086-427a-acc3-c51b127dfb44', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036a5c80-90fa-42ba-9549-69bef468969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036a5c80-90fa-42ba-9549-69bef468969b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54899d69-fdaf-4e74-91c6-c15609f6aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:32 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Volume c89e85f7-b086-427a-acc3-c51b127dfb44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89e85f7-b086-427a-acc3-c51b127dfb44', 'volume_size': 1} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1424578096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89e85f7-b086-427a-acc3-c51b127dfb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578c43b846d14449829acbf73e0cba1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:32Z,use_quota=True,user_id='0baeb2ebbbab476fb452d501f46ebe3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Creating volume c89e85f7-b086-427a-acc3-c51b127dfb44 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:32 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:32 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 1073741824 Jul 29 16:16:32 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-540e69aa-64cd-406e-940d-e7386ff59cf6-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-540e69aa-64cd-406e-940d-e7386ff59cf6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:32 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.298s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:32 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleted volume successfully. Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-540e69aa-64cd-406e-940d-e7386ff59cf6" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-540e69aa-64cd-406e-940d-e7386ff59cf6" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-543607cb-ad50-4db9-8d37-4ded36122180 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-6cf385b2-f03b-4739-9b8e-75501d4ba4aa-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ebc78-ea63-417e-bd5e-c2e6d6719344]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:32 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 Jul 29 16:16:32 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:32 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 1073741824" returned: 0 in 0.562s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:32 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6" returned: 0 in 0.440s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:32 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 Jul 29 16:16:32 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:32 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6 Jul 29 16:16:32 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:33 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-540e69aa-64cd-406e-940d-e7386ff59cf6" returned: 0 in 0.310s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:33 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44" returned: 0 in 0.354s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-540e69aa-64cd-406e-940d-e7386ff59cf6" released by "delete_volume" :: held 0.823s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54899d69-fdaf-4e74-91c6-c15609f6aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89e85f7-b086-427a-acc3-c51b127dfb44', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57db748-0d0f-4152-a657-efaa3906b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Volume volume-c89e85f7-b086-427a-acc3-c51b127dfb44 (c89e85f7-b086-427a-acc3-c51b127dfb44): created successfully Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57db748-0d0f-4152-a657-efaa3906b932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Flow 'volume_create_manager' (c88b2c5a-f81b-4c42-bc25-8416d7958763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ab719b94-bb57-4154-9adc-3851d4884cc6 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Created volume successfully. Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['3760b4fc-1f40-4b7d-9f32-20267257a03d', '573d838e-f605-4289-89b6-892821c6d785', '80746d88-0eb0-4c5e-8e31-51b305c08843', '7ce564f3-c5a7-4a8f-8277-305c5e54688a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:33 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:33 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-4e2e49e1-560b-4d11-aad4-f680f7fb31f6-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-4e2e49e1-560b-4d11-aad4-f680f7fb31f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-e2d2d426-3d10-449b-89f1-e4318481ae55" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-e2d2d426-3d10-449b-89f1-e4318481ae55" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-4e2e49e1-560b-4d11-aad4-f680f7fb31f6" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-4e2e49e1-560b-4d11-aad4-f680f7fb31f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleting offline snapshot 4e2e49e1-560b-4d11-aad4-f680f7fb31f6 of volume e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] snapshot_file for this snap is: volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46dea0-ec5e-4700-bb84-bf5b70641342]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:33 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleted volume successfully. Jul 29 16:16:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b0ceff93-1334-4b7c-83a6-53d91502a233 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-540e69aa-64cd-406e-940d-e7386ff59cf6-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:33 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 Jul 29 16:16:33 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:34 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6" returned: 0 in 0.410s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2d2d426-3d10-449b-89f1-e4318481ae55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f1f72-2af3-4ead-9885-0628676d1cff]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:34 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 Jul 29 16:16:34 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:34 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:34 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 Jul 29 16:16:34 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:34 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6" returned: 0 in 0.399s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:34 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6 Jul 29 16:16:34 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-6e3c0f50-b2e2-4489-9de8-06331101fbd9 req-c0078a00-358a-4f4c-94ce-8fd7c76b2c4b tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-6e3c0f50-b2e2-4489-9de8-06331101fbd9 req-c0078a00-358a-4f4c-94ce-8fd7c76b2c4b tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-6e3c0f50-b2e2-4489-9de8-06331101fbd9 req-c0078a00-358a-4f4c-94ce-8fd7c76b2c4b tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-6e3c0f50-b2e2-4489-9de8-06331101fbd9 req-c0078a00-358a-4f4c-94ce-8fd7c76b2c4b tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-c89e85f7-b086-427a-acc3-c51b127dfb44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cba0ed5-29f8-48a8-b37a-0f9eed7102e1', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:16:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-6e3c0f50-b2e2-4489-9de8-06331101fbd9 req-c0078a00-358a-4f4c-94ce-8fd7c76b2c4b tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] attachment_update completed successfully. Jul 29 16:16:35 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55.4e2e49e1-560b-4d11-aad4-f680f7fb31f6" returned: 0 in 0.291s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-4e2e49e1-560b-4d11-aad4-f680f7fb31f6" released by "_delete_snapshot" :: held 1.626s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-e2d2d426-3d10-449b-89f1-e4318481ae55" released by "delete_snapshot" :: held 1.652s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['dabb5ce9-a4dd-4c5d-8ee8-b52bbe70b95b', 'c8832602-3a58-47b0-a159-5a3373f5ccbd', 'b9f7bccf-5ab9-4671-9637-ecffe4cd1a1d', '7f845622-b76f-433b-a66d-19995c436009'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Delete snapshot completed successfully. Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1c2dd39b-9524-466a-810d-088d270bc1a3 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-4e2e49e1-560b-4d11-aad4-f680f7fb31f6-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-e2d2d426-3d10-449b-89f1-e4318481ae55-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-e2d2d426-3d10-449b-89f1-e4318481ae55-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "cinder-quobyte-e2d2d426-3d10-449b-89f1-e4318481ae55" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-e2d2d426-3d10-449b-89f1-e4318481ae55" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be4c8a-8808-4040-b461-8fd39f9327ec]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:35 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 Jul 29 16:16:35 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:36 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:36 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55 Jul 29 16:16:36 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:36 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e2d2d426-3d10-449b-89f1-e4318481ae55" returned: 0 in 0.257s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-quobyte-e2d2d426-3d10-449b-89f1-e4318481ae55" released by "delete_volume" :: held 0.757s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Created reservations ['668ca020-41cd-4261-9996-810c8552aca3', 'ef76dd95-402b-42af-a9ce-8dc6b91611ed', 'f5ce149b-f36d-4598-8aed-8a0a74badaaa', '6c5e57ee-a788-4bc8-a8fd-40657e951120'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:36 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:36 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:36 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:36 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:36 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.274s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Deleted volume successfully. Jul 29 16:16:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f332b6e2-3d0e-4c5e-bbce-3af7b72a36d0 tempest-CreateVolumesFromSnapshotTest-1050926873 None] Lock "cinder-e2d2d426-3d10-449b-89f1-e4318481ae55-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:37 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-319971bd-5f00-4741-b2ba-bb93e85b1222 req-c52eff13-3e01-48ee-a2c5-de29db11ae5a tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Terminate volume connection completed successfully. Jul 29 16:16:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-319971bd-5f00-4741-b2ba-bb93e85b1222 req-c52eff13-3e01-48ee-a2c5-de29db11ae5a tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Deleting attachment 5cba0ed5-29f8-48a8-b37a-0f9eed7102e1. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Acquiring lock "cinder-c89e85f7-b086-427a-acc3-c51b127dfb44-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "cinder-c89e85f7-b086-427a-acc3-c51b127dfb44-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Acquiring lock "cinder-quobyte-c89e85f7-b086-427a-acc3-c51b127dfb44" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "cinder-quobyte-c89e85f7-b086-427a-acc3-c51b127dfb44" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5011e1-ea42-4438-a9f1-c8abcbd65b08]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:39 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 Jul 29 16:16:39 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:39 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44" returned: 0 in 0.405s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:39 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44 Jul 29 16:16:39 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:40 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c89e85f7-b086-427a-acc3-c51b127dfb44" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "cinder-quobyte-c89e85f7-b086-427a-acc3-c51b127dfb44" released by "delete_volume" :: held 0.745s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Created reservations ['68f85e28-9f11-4496-b397-7284fba72ca4', '4a483564-a66b-450f-837f-73d823b2184d', 'a7aef068-a5bb-4f53-bac3-8d674ca0749b', '331739a9-b920-467e-ac4e-d2e0de7f1c58'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:40 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:40 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:40 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.378s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Deleted volume successfully. Jul 29 16:16:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2c1208bd-1747-4c37-8f4f-73ec80de1a91 tempest-TestServerVolumeAttachScenarioOldVersion-489207232 None] Lock "cinder-c89e85f7-b086-427a-acc3-c51b127dfb44-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Flow 'volume_create_manager' (a29c4f11-7f03-4ee2-b645-eba8d476dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ff03c8-cfd1-4e92-941f-9c9278001fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ff03c8-cfd1-4e92-941f-9c9278001fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bb2416-2bea-47c8-b7ec-c0544ac9ac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd23c52481b4e7c8c94c0921ab87c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:43Z,use_quota=True,user_id='10090553577e45d2a0d92ccc6d20a003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e813aa-bb0f-45b1-acfc-6be6193a6156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e813aa-bb0f-45b1-acfc-6be6193a6156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e7803-7e20-4de4-989b-35b48ed91e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e7803-7e20-4de4-989b-35b48ed91e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97bb2416-2bea-47c8-b7ec-c0544ac9ac3c', 'volume_name': 'volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c', 'volume_size': 1, 'image_id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/989df7ac-be24-427a-8d67-74671c36a4e7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caab22be6538e16fb3bdcdf4aae7b150', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbd23c52481b4e7c8c94c0921ab87c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a55f610f7ec5823a145fb38b4a31e4a40a8b6ff7c6acd1c95e32c0bdc92bbb8daa1894842ef8fc1c13c489987e84e1c8645778d594607cca69e27987a62c3754', 'id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'created_at': datetime.datetime(2026, 7, 29, 14, 16, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 16, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/989df7ac-be24-427a-8d67-74671c36a4e7/file', 'properties': {}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b1cd08-4812-4348-8f31-a7b757896d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b1cd08-4812-4348-8f31-a7b757896d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a053683e-57e2-4c76-887e-3d2cb7eac060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:43 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Volume 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c', 'volume_size': 1, 'image_id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/989df7ac-be24-427a-8d67-74671c36a4e7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caab22be6538e16fb3bdcdf4aae7b150', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbd23c52481b4e7c8c94c0921ab87c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a55f610f7ec5823a145fb38b4a31e4a40a8b6ff7c6acd1c95e32c0bdc92bbb8daa1894842ef8fc1c13c489987e84e1c8645778d594607cca69e27987a62c3754', 'id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'created_at': datetime.datetime(2026, 7, 29, 14, 16, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 16, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/989df7ac-be24-427a-8d67-74671c36a4e7/file', 'properties': {}}, 'image_service': } Jul 29 16:16:43 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Trying to clone 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c from image 989df7ac-be24-427a-8d67-74671c36a4e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/989df7ac-be24-427a-8d67-74671c36a4e7', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:16:44 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Image download 0.00 MB at 0.00 MB/s Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d33f91-7b42-4393-885d-153a704de81c]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:44 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD Jul 29 16:16:44 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:44 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:44 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD Jul 29 16:16:44 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Flow 'volume_create_manager' (b6fcaa04-c7dd-43b9-98c3-9dc3cc575a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67879bff-fa6c-4b3c-9d9b-76334b53a76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67879bff-fa6c-4b3c-9d9b-76334b53a76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2108788174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7ca709-0482-47c0-9bc9-54b7626355c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7f6a0995b4cae9fe63fa2fa8cbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:45Z,use_quota=True,user_id='10962c7a118e40f4ac91cc06693f8b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a41e283-4e27-4b15-8006-58399c15470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a41e283-4e27-4b15-8006-58399c15470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ff971c-065b-48f5-a749-cd5e8fa45656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ff971c-065b-48f5-a749-cd5e8fa45656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7ca709-0482-47c0-9bc9-54b7626355c4', 'volume_name': 'volume-bb7ca709-0482-47c0-9bc9-54b7626355c4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e4479d-0a63-452a-ae28-cd8a7455de6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e4479d-0a63-452a-ae28-cd8a7455de6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba33bb0-e067-4f26-8318-13bd8e65badb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:44 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Volume bb7ca709-0482-47c0-9bc9-54b7626355c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7ca709-0482-47c0-9bc9-54b7626355c4', 'volume_size': 1} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2108788174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7ca709-0482-47c0-9bc9-54b7626355c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7f6a0995b4cae9fe63fa2fa8cbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:45Z,use_quota=True,user_id='10962c7a118e40f4ac91cc06693f8b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Creating volume bb7ca709-0482-47c0-9bc9-54b7626355c4 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:44 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:44 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 1073741824 Jul 29 16:16:44 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:44 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Temporary image 989df7ac-be24-427a-8d67-74671c36a4e7 is fetched for user 10090553577e45d2a0d92ccc6d20a003. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[547060f2-f014-489c-b355-3ed3a099cb2d]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:45 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD Jul 29 16:16:45 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:45 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 1073741824" returned: 0 in 0.528s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:45 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 Jul 29 16:16:45 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:45 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:45 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD Jul 29 16:16:45 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:45 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4" returned: 0 in 0.360s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba33bb0-e067-4f26-8318-13bd8e65badb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7ca709-0482-47c0-9bc9-54b7626355c4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc63a4e-4cd7-4b0e-a359-fec77350ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:45 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Volume volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 (bb7ca709-0482-47c0-9bc9-54b7626355c4): created successfully Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc63a4e-4cd7-4b0e-a359-fec77350ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Flow 'volume_create_manager' (b6fcaa04-c7dd-43b9-98c3-9dc3cc575a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6d049ab7-486e-45f4-afd7-9899f199debf tempest-AttachVolumeNegativeTest-240557135 None] Created volume successfully. Jul 29 16:16:45 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bb2416-2bea-47c8-b7ec-c0544ac9ac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd23c52481b4e7c8c94c0921ab87c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:16:43Z,use_quota=True,user_id='10090553577e45d2a0d92ccc6d20a003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Creating volume 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:16:45 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:16:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:45 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c 1073741824 Jul 29 16:16:45 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:46 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c 1073741824" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:46 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c Jul 29 16:16:46 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:46 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Attempting download of 989df7ac-be24-427a-8d67-74671c36a4e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/989df7ac-be24-427a-8d67-74671c36a4e7', 'metadata': {}}])) to volume 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[77376d3e-aedf-477b-bc53-ea7ba38006cc]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:46 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8 Jul 29 16:16:46 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:47 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8" returned: 0 in 0.415s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:47 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8 Jul 29 16:16:47 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:47 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8" returned: 1 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_989df7ac-be24-427a-8d67-74671c36a4e7_n1wj4_l8' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[66308797-36f8-4188-b1d7-05525430eb27]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:47 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD Jul 29 16:16:47 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c86999e7-b003-4dcd-a89e-27bef699a87a req-b4518390-c0a8-4eb2-bb2d-b57e40626ab0 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c86999e7-b003-4dcd-a89e-27bef699a87a req-b4518390-c0a8-4eb2-bb2d-b57e40626ab0 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-c86999e7-b003-4dcd-a89e-27bef699a87a req-b4518390-c0a8-4eb2-bb2d-b57e40626ab0 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-c86999e7-b003-4dcd-a89e-27bef699a87a req-b4518390-c0a8-4eb2-bb2d-b57e40626ab0 tempest-AttachVolumeNegativeTest-240557135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-bb7ca709-0482-47c0-9bc9-54b7626355c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96b1f112-96ba-4a55-b2a0-5695f5b8afa8', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:16:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-c86999e7-b003-4dcd-a89e-27bef699a87a req-b4518390-c0a8-4eb2-bb2d-b57e40626ab0 tempest-AttachVolumeNegativeTest-240557135 None] attachment_update completed successfully. Jul 29 16:16:47 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:48 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD Jul 29 16:16:48 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:48 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] 989df7ac-be24-427a-8d67-74671c36a4e7 was raw, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:48 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c Jul 29 16:16:48 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:48 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" returned: 0 in 0.616s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_989df7ac-be24-427a-8d67-74671c36a4e7_7ri8zgowdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:16:48 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Converted 0.00 MB image at 0.00 MB/s Jul 29 16:16:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:48 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c 1G Jul 29 16:16:48 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:49 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c 1G" returned: 0 in 0.410s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Downloaded image 989df7ac-be24-427a-8d67-74671c36a4e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/989df7ac-be24-427a-8d67-74671c36a4e7', 'metadata': {}}])) to volume 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Temporary image 989df7ac-be24-427a-8d67-74671c36a4e7 for user 10090553577e45d2a0d92ccc6d20a003 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Marking volume 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Copying metadata from image 989df7ac-be24-427a-8d67-74671c36a4e7 to 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Creating volume glance metadata for volume 97bb2416-2bea-47c8-b7ec-c0544ac9ac3c backed by image 989df7ac-be24-427a-8d67-74671c36a4e7 with: {'image_id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'caab22be6538e16fb3bdcdf4aae7b150', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a053683e-57e2-4c76-887e-3d2cb7eac060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c', 'volume_size': 1, 'image_id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/989df7ac-be24-427a-8d67-74671c36a4e7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caab22be6538e16fb3bdcdf4aae7b150', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbd23c52481b4e7c8c94c0921ab87c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a55f610f7ec5823a145fb38b4a31e4a40a8b6ff7c6acd1c95e32c0bdc92bbb8daa1894842ef8fc1c13c489987e84e1c8645778d594607cca69e27987a62c3754', 'id': '989df7ac-be24-427a-8d67-74671c36a4e7', 'created_at': datetime.datetime(2026, 7, 29, 14, 16, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 16, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/989df7ac-be24-427a-8d67-74671c36a4e7/file', 'properties': {}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf0ba35-a555-47b9-8d9e-d65172157d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:16:49 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Volume volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c (97bb2416-2bea-47c8-b7ec-c0544ac9ac3c): created successfully Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf0ba35-a555-47b9-8d9e-d65172157d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:16:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Flow 'volume_create_manager' (a29c4f11-7f03-4ee2-b645-eba8d476dabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:16:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-701eeec1-5df5-4d85-894e-1def93605df6 tempest-VolumeImageDependencyTests-1215815389 None] Created volume successfully. Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Acquiring lock "cinder-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Lock "cinder-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Acquiring lock "cinder-quobyte-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Lock "cinder-quobyte-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d272ae2b-0dbc-42ef-be82-3739dc6aed4e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:50 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c Jul 29 16:16:50 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:50 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" returned: 0 in 0.398s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:50 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c Jul 29 16:16:50 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-b5a171ad-3008-42d0-b386-92773b28782b req-4dbe5863-a0d9-4136-8f8d-8cc2d3e9008e tempest-AttachVolumeNegativeTest-240557135 None] Terminate volume connection completed successfully. Jul 29 16:16:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-b5a171ad-3008-42d0-b386-92773b28782b req-4dbe5863-a0d9-4136-8f8d-8cc2d3e9008e tempest-AttachVolumeNegativeTest-240557135 None] Deleting attachment 96b1f112-96ba-4a55-b2a0-5695f5b8afa8. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:16:51 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" returned: 0 in 0.332s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Lock "cinder-quobyte-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c" released by "delete_volume" :: held 0.781s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Created reservations ['1a5ecf17-8671-40a3-9898-1425f7b02151', '2d6ebd3a-b197-4951-a9a3-5e7b704d0759', '1876dc57-a3ee-4675-bbf8-73515f5845b9', '0b71ca28-7bf8-411a-b519-b1a670cb46c1'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:16:51 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:16:51 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:16:51 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.351s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:16:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Deleted volume successfully. Jul 29 16:16:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fedc2f53-e5bb-4c1f-ab6e-f96a32702fa4 tempest-VolumeImageDependencyTests-1215815389 None] Lock "cinder-97bb2416-2bea-47c8-b7ec-c0544ac9ac3c-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=91,cinder:UPDATE=110,cinder:DELETE=9,cinder:INSERT=25 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:17:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=95,cinder:DELETE=9 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Flow 'volume_create_manager' (967f0602-550c-4bdd-9eae-eaaf21e6c6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b055c77-1bd3-4400-af7b-ef40dd6e888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b055c77-1bd3-4400-af7b-ef40dd6e888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1727890078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5631f1ef-aad7-4538-96ec-d0d22a092c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ef1a1d63194cadb379b3fbbeebb533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:17:25Z,use_quota=True,user_id='a2eb1a4af269427bba8369f4851e0527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f42c271-1ee3-4627-b3a1-8a7d5cefa087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f42c271-1ee3-4627-b3a1-8a7d5cefa087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b118720-b05e-46da-888a-f2189e1e7234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b118720-b05e-46da-888a-f2189e1e7234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5631f1ef-aad7-4538-96ec-d0d22a092c38', 'volume_name': 'volume-5631f1ef-aad7-4538-96ec-d0d22a092c38', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56b97e5-107b-4eb9-ac5f-255a835e3c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56b97e5-107b-4eb9-ac5f-255a835e3c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9109475a-6978-4796-860e-821da6b69bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:24 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Volume 5631f1ef-aad7-4538-96ec-d0d22a092c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5631f1ef-aad7-4538-96ec-d0d22a092c38', 'volume_size': 1} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1727890078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5631f1ef-aad7-4538-96ec-d0d22a092c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ef1a1d63194cadb379b3fbbeebb533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:17:25Z,use_quota=True,user_id='a2eb1a4af269427bba8369f4851e0527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Creating volume 5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:17:24 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:17:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:24 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 1073741824 Jul 29 16:17:24 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:25 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 1073741824" returned: 0 in 0.521s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:25 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:17:25 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:25 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9109475a-6978-4796-860e-821da6b69bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5631f1ef-aad7-4538-96ec-d0d22a092c38', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b506af8b-35b6-4cfb-9b69-cfe8d3bd3b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:25 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Volume volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 (5631f1ef-aad7-4538-96ec-d0d22a092c38): created successfully Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b506af8b-35b6-4cfb-9b69-cfe8d3bd3b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Flow 'volume_create_manager' (967f0602-550c-4bdd-9eae-eaaf21e6c6f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:17:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-026a5b99-3e98-4402-b771-ff8f8cfc6b68 tempest-TestStampPattern-1595417922 None] Created volume successfully. Jul 29 16:17:30 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Flow 'volume_create_manager' (908114f1-23dd-4f7c-bdfe-b4299f173277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3552904c-9eec-4cd8-a9fe-c7543cd960ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3552904c-9eec-4cd8-a9fe-c7543cd960ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2005703081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2963e932-c8f4-4f07-a405-6fa2f00a9f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7f6a0995b4cae9fe63fa2fa8cbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:17:31Z,use_quota=True,user_id='10962c7a118e40f4ac91cc06693f8b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f45a5a-8436-45d2-9a1d-689ecb4ef204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f45a5a-8436-45d2-9a1d-689ecb4ef204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66d9fa0-e367-4962-be9d-f30143a9ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66d9fa0-e367-4962-be9d-f30143a9ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2963e932-c8f4-4f07-a405-6fa2f00a9f24', 'volume_name': 'volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f913e0c2-d84c-4881-80fc-d89f054b7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f913e0c2-d84c-4881-80fc-d89f054b7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6630ea9-f9aa-478e-894c-24716441f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:31 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Volume 2963e932-c8f4-4f07-a405-6fa2f00a9f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24', 'volume_size': 1} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2005703081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2963e932-c8f4-4f07-a405-6fa2f00a9f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7f6a0995b4cae9fe63fa2fa8cbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:17:31Z,use_quota=True,user_id='10962c7a118e40f4ac91cc06693f8b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Creating volume 2963e932-c8f4-4f07-a405-6fa2f00a9f24 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:17:31 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:31 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 1073741824 Jul 29 16:17:31 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:31 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 1073741824" returned: 0 in 0.450s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:31 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 Jul 29 16:17:31 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:31 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6630ea9-f9aa-478e-894c-24716441f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789636b5-b91b-4a28-88e0-a24e0c80e9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:31 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Volume volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 (2963e932-c8f4-4f07-a405-6fa2f00a9f24): created successfully Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789636b5-b91b-4a28-88e0-a24e0c80e9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Flow 'volume_create_manager' (908114f1-23dd-4f7c-bdfe-b4299f173277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:17:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-04c0c5ed-abed-4bba-947a-f3c714ab729c tempest-AttachVolumeNegativeTest-240557135 None] Created volume successfully. Jul 29 16:17:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-edef0616-b80c-463c-86d8-f129c32957d3 req-a40e4776-cbc1-46ef-b342-4b3104b87e83 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-edef0616-b80c-463c-86d8-f129c32957d3 req-a40e4776-cbc1-46ef-b342-4b3104b87e83 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-edef0616-b80c-463c-86d8-f129c32957d3 req-a40e4776-cbc1-46ef-b342-4b3104b87e83 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-edef0616-b80c-463c-86d8-f129c32957d3 req-a40e4776-cbc1-46ef-b342-4b3104b87e83 tempest-AttachVolumeNegativeTest-240557135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '072fecf1-3751-4dbb-bf8b-378d02bc15b6', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:17:34 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-edef0616-b80c-463c-86d8-f129c32957d3 req-a40e4776-cbc1-46ef-b342-4b3104b87e83 tempest-AttachVolumeNegativeTest-240557135 None] attachment_update completed successfully. Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:36 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:17:36 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-996897b9-50ca-48a4-b8e1-7562462a102e req-cd1bf223-a3a3-4293-a282-999dd0212088 tempest-AttachVolumeNegativeTest-240557135 None] Terminate volume connection completed successfully. Jul 29 16:17:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-996897b9-50ca-48a4-b8e1-7562462a102e req-cd1bf223-a3a3-4293-a282-999dd0212088 tempest-AttachVolumeNegativeTest-240557135 None] Deleting attachment 072fecf1-3751-4dbb-bf8b-378d02bc15b6. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:17:37 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.379s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "cinder-2963e932-c8f4-4f07-a405-6fa2f00a9f24-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-2963e932-c8f4-4f07-a405-6fa2f00a9f24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "cinder-quobyte-2963e932-c8f4-4f07-a405-6fa2f00a9f24" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-quobyte-2963e932-c8f4-4f07-a405-6fa2f00a9f24" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2847f2cb-ccac-49b6-8d4d-b40a98c2117d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:41 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 Jul 29 16:17:41 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:41 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24" returned: 0 in 0.360s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:41 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24 Jul 29 16:17:41 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:42 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2963e932-c8f4-4f07-a405-6fa2f00a9f24" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-quobyte-2963e932-c8f4-4f07-a405-6fa2f00a9f24" released by "delete_volume" :: held 0.684s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Created reservations ['1b0998f8-063e-43e4-9b16-c2d8b8ac273d', '8b60fa24-a58c-4725-8026-27cb28a1d47c', '99b3c678-7cd3-46b5-a37e-2cb8c7eaf467', '6b3d719b-9d53-468b-9a0e-6338017c5ac5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:42 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:17:42 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:42 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:17:42 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Deleted volume successfully. Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d0df28d0-e5bb-4b0a-8e37-ff4d1286352f tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-2963e932-c8f4-4f07-a405-6fa2f00a9f24-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "cinder-bb7ca709-0482-47c0-9bc9-54b7626355c4-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-bb7ca709-0482-47c0-9bc9-54b7626355c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "cinder-quobyte-bb7ca709-0482-47c0-9bc9-54b7626355c4" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-quobyte-bb7ca709-0482-47c0-9bc9-54b7626355c4" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e6b5d-5133-4d11-b6b7-edb7b721a595]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:17:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:42 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 Jul 29 16:17:42 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:43 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4" returned: 0 in 0.345s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:43 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4 Jul 29 16:17:43 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:43 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bb7ca709-0482-47c0-9bc9-54b7626355c4" returned: 0 in 0.241s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-quobyte-bb7ca709-0482-47c0-9bc9-54b7626355c4" released by "delete_volume" :: held 0.629s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Created reservations ['7a965d52-e136-4bde-a20a-aadfd845e950', '976b94e9-f6c9-41d7-8a4b-0048d4cc5f56', '42519bfd-779c-4594-bedf-19f9c678f906', '0300b1e4-ae15-477c-91ec-b8350f54948d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:43 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:17:43 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:43 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:17:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Deleted volume successfully. Jul 29 16:17:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-38092ab1-364b-418f-a74c-77b8cca59e43 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-bb7ca709-0482-47c0-9bc9-54b7626355c4-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "cinder-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "cinder-quobyte-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-quobyte-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4589a97-c4be-47b3-b3f2-82a47869fb55]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:44 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 Jul 29 16:17:44 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:44 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0" returned: 0 in 0.362s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:44 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0 Jul 29 16:17:44 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:44 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0" returned: 0 in 0.246s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-quobyte-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0" released by "delete_volume" :: held 0.655s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Created reservations ['bf64b2c2-25c7-4423-9d11-c5da9396297f', '97f26294-23cb-449b-9cbf-67fe7a58ebfa', '273ff55d-680d-447e-825d-c04d9cc84ae9', '98959fef-ecc5-44a2-b79d-8e0bbd84b1ce'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:45 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:17:45 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:45 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:45 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:17:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Deleted volume successfully. Jul 29 16:17:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee297de0-9e3a-4599-9feb-1af330bf78f2 tempest-AttachVolumeNegativeTest-240557135 None] Lock "cinder-f50040e9-6a5e-4cf3-8fbc-75f26a7c37e0-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:17:54 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=8 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:17:55 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:17:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b09b8da7-0229-48da-bff2-32ce1f2566b3 tempest-GroupsTest-1810280597 None] Group tempest-Group1-986218523: creating Jul 29 16:17:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b09b8da7-0229-48da-bff2-32ce1f2566b3 tempest-GroupsTest-1810280597 None] Group tempest-Group1-986218523: created successfully Jul 29 16:17:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b09b8da7-0229-48da-bff2-32ce1f2566b3 tempest-GroupsTest-1810280597 None] Create group completed successfully. Jul 29 16:17:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-272f91db-f92c-4913-ac77-6dceacf2a178 req-61333702-c332-4919-8ce5-dfcd8c804940 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-272f91db-f92c-4913-ac77-6dceacf2a178 req-61333702-c332-4919-8ce5-dfcd8c804940 tempest-TestStampPattern-1595417922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-272f91db-f92c-4913-ac77-6dceacf2a178 req-61333702-c332-4919-8ce5-dfcd8c804940 tempest-TestStampPattern-1595417922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-272f91db-f92c-4913-ac77-6dceacf2a178 req-61333702-c332-4919-8ce5-dfcd8c804940 tempest-TestStampPattern-1595417922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-5631f1ef-aad7-4538-96ec-d0d22a092c38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fbdb01c-8612-45aa-9e38-c25e88e142c1', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:17:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-272f91db-f92c-4913-ac77-6dceacf2a178 req-61333702-c332-4919-8ce5-dfcd8c804940 tempest-TestStampPattern-1595417922 None] attachment_update completed successfully. Jul 29 16:17:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4772c498-2df1-407b-8a70-aaf4cf4ac6b5 tempest-GroupsTest-1810280597 None] Group tempest-Group2-2093427272: creating Jul 29 16:17:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4772c498-2df1-407b-8a70-aaf4cf4ac6b5 tempest-GroupsTest-1810280597 None] Group tempest-Group2-2093427272: created successfully Jul 29 16:17:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4772c498-2df1-407b-8a70-aaf4cf4ac6b5 tempest-GroupsTest-1810280597 None] Create group completed successfully. Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Flow 'volume_create_manager' (c1160cd7-7839-4c41-bb62-82749ee17e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d4d93a-43f8-49f2-97fa-3de7de89fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d4d93a-43f8-49f2-97fa-3de7de89fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974928871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=668d0af0-b3a9-4fd2-bd5a-310ad50eecb8,host='devstack@QuobyteHD#QuobyteHD',id=5be5b91c-a571-45cf-9dff-22ea62172fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4cf98c42a24745a29b9cb52051b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:17:59Z,use_quota=True,user_id='8cad7ad9349643e3ad23e0941f7f94ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dea6f8bd-107f-424b-8d1f-113ea21cb008),volume_type_id=dea6f8bd-107f-424b-8d1f-113ea21cb008)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca827d2f-f619-46b1-96bb-57fdac3d1730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca827d2f-f619-46b1-96bb-57fdac3d1730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ac147d-5a38-4a79-bcb3-15098becc1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ac147d-5a38-4a79-bcb3-15098becc1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be5b91c-a571-45cf-9dff-22ea62172fc9', 'volume_name': 'volume-5be5b91c-a571-45cf-9dff-22ea62172fc9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17244bf-f54f-4650-9572-6b2085b7d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17244bf-f54f-4650-9572-6b2085b7d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7418db7-9a0e-44f1-a42f-e447da5b4134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:17:59 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Volume 5be5b91c-a571-45cf-9dff-22ea62172fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be5b91c-a571-45cf-9dff-22ea62172fc9', 'volume_size': 1} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=668d0af0-b3a9-4fd2-bd5a-310ad50eecb8,created_at=2026-07-29T14:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974928871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=668d0af0-b3a9-4fd2-bd5a-310ad50eecb8,host='devstack@QuobyteHD#QuobyteHD',id=5be5b91c-a571-45cf-9dff-22ea62172fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4cf98c42a24745a29b9cb52051b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:17:59Z,use_quota=True,user_id='8cad7ad9349643e3ad23e0941f7f94ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dea6f8bd-107f-424b-8d1f-113ea21cb008),volume_type_id=dea6f8bd-107f-424b-8d1f-113ea21cb008)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Creating volume 5be5b91c-a571-45cf-9dff-22ea62172fc9 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:17:59 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:59 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 1073741824 Jul 29 16:17:59 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:59 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 1073741824" returned: 0 in 0.459s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:17:59 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 Jul 29 16:17:59 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:17:59 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:17:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7418db7-9a0e-44f1-a42f-e447da5b4134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be5b91c-a571-45cf-9dff-22ea62172fc9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974131c5-2b97-41dc-8568-5c6a58df7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:00 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Volume volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 (5be5b91c-a571-45cf-9dff-22ea62172fc9): created successfully Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974131c5-2b97-41dc-8568-5c6a58df7549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Flow 'volume_create_manager' (c1160cd7-7839-4c41-bb62-82749ee17e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2a462681-8337-44d1-aa4d-f543dedb807c tempest-GroupsTest-1810280597 None] Created volume successfully. Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Acquiring lock "cinder-quobyte-5be5b91c-a571-45cf-9dff-22ea62172fc9" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Lock "cinder-quobyte-5be5b91c-a571-45cf-9dff-22ea62172fc9" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26cd165-6124-448b-a0da-44c8b19ee31a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:01 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 Jul 29 16:18:01 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:01 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9" returned: 0 in 0.404s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:01 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9 Jul 29 16:18:01 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:01 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5be5b91c-a571-45cf-9dff-22ea62172fc9" returned: 0 in 0.260s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Lock "cinder-quobyte-5be5b91c-a571-45cf-9dff-22ea62172fc9" released by "delete_volume" :: held 0.716s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Created reservations ['977a0fca-edbd-4ef6-bf7f-61412e9bfa0c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:01 devstack cinder-volume[88575]: WARNING cinder.quota [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2133845711 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2133845711, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:18:01 devstack cinder-volume[88575]: WARNING cinder.quota [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2133845711 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2133845711, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Created reservations ['043c4f3e-dd44-4e58-8154-d98b357fed5e', '3219d844-2e35-41d8-bb06-9d2c8b3a075d', 'caa6dfbb-1957-4cb9-99c8-42c8869a7eb6', 'efd65a78-423f-4c3f-86f5-c96f27393b0f'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:01 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:18:01 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:02 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.305s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:18:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-10e82e3b-92c1-4f4c-ae60-779236348c86 tempest-GroupsTest-1810280597 None] Delete group completed successfully. Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Created reservations ['f0af0580-1b7d-41ea-b8f2-38a3ab6d0335'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:02 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:18:02 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-1039a442-24be-429b-a302-0e4e5cadc58b req-498f5c2e-6a3d-4e4e-9826-0b8e4dc407d6 tempest-TestStampPattern-1595417922 None] Terminate volume connection completed successfully. Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-1039a442-24be-429b-a302-0e4e5cadc58b req-498f5c2e-6a3d-4e4e-9826-0b8e4dc407d6 tempest-TestStampPattern-1595417922 None] Deleting attachment 2fbdb01c-8612-45aa-9e38-c25e88e142c1. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:18:02 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:02 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:18:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-030a9e94-307f-4a2f-a5e7-3e0f4889fdb7 tempest-GroupsTest-1810280597 None] Delete group completed successfully. Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Creating offline snapshot ac0daf5b-4771-4b05-a452-6a94827dad5d of volume 5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8971342-99a5-4831-9285-aa5d8e4578f6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:03 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:18:03 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:03 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.397s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:03 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d 1G Jul 29 16:18:03 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b7be8481-e18b-4700-ae66-1a7b5e58d328 tempest-GroupsTest-1810280597 None] Group tempest-GroupsTest-Group-660504918: creating Jul 29 16:18:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b7be8481-e18b-4700-ae66-1a7b5e58d328 tempest-GroupsTest-1810280597 None] Group tempest-GroupsTest-Group-660504918: created successfully Jul 29 16:18:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b7be8481-e18b-4700-ae66-1a7b5e58d328 tempest-GroupsTest-1810280597 None] Create group completed successfully. Jul 29 16:18:04 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d 1G" returned: 0 in 0.396s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:04 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d Jul 29 16:18:04 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:04 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d" returned: 0 in 0.283s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:04 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d is being set with open permissions: ugo+rw Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:04 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d Jul 29 16:18:04 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:04 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d" returned: 0 in 0.255s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:04 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info Jul 29 16:18:04 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:04 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:04 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info is being set with open permissions: ugo+rw Jul 29 16:18:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:04 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info Jul 29 16:18:04 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:05 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.info" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9bc2bf9b-1c35-48e3-a317-5d4191fb2019 tempest-TestStampPattern-1595417922 None] Create snapshot completed successfully Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Flow 'volume_create_manager' (1e2d3c1f-fa42-4bb2-b15c-67b419631d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3cc42c-11d5-4fa8-bf91-6d78a9e8d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3cc42c-11d5-4fa8-bf91-6d78a9e8d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126112753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d0c23ff-eded-4c85-93f6-683412552809,host='devstack@QuobyteHD#QuobyteHD',id=4631132d-2099-4587-8c1e-d98b96884907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4cf98c42a24745a29b9cb52051b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:05Z,use_quota=True,user_id='8cad7ad9349643e3ad23e0941f7f94ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46299f59-79f6-4c25-a1ea-8c7c133e24d5),volume_type_id=46299f59-79f6-4c25-a1ea-8c7c133e24d5)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437fb8e3-2a93-40f7-b9f1-2af9215f7aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437fb8e3-2a93-40f7-b9f1-2af9215f7aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af291cd9-43cb-43a7-839c-b26ebde18140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af291cd9-43cb-43a7-839c-b26ebde18140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4631132d-2099-4587-8c1e-d98b96884907', 'volume_name': 'volume-4631132d-2099-4587-8c1e-d98b96884907', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3232fb81-7b70-491c-9dd9-9f91c645e9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3232fb81-7b70-491c-9dd9-9f91c645e9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb00e68-db13-4170-b830-f8318eb1f5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Volume 4631132d-2099-4587-8c1e-d98b96884907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4631132d-2099-4587-8c1e-d98b96884907', 'volume_size': 1} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d0c23ff-eded-4c85-93f6-683412552809,created_at=2026-07-29T14:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126112753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d0c23ff-eded-4c85-93f6-683412552809,host='devstack@QuobyteHD#QuobyteHD',id=4631132d-2099-4587-8c1e-d98b96884907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4cf98c42a24745a29b9cb52051b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:05Z,use_quota=True,user_id='8cad7ad9349643e3ad23e0941f7f94ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46299f59-79f6-4c25-a1ea-8c7c133e24d5),volume_type_id=46299f59-79f6-4c25-a1ea-8c7c133e24d5)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Creating volume 4631132d-2099-4587-8c1e-d98b96884907 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:18:05 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:18:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:05 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 1073741824 Jul 29 16:18:05 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:06 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 1073741824" returned: 0 in 0.531s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:06 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 Jul 29 16:18:06 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:06 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb00e68-db13-4170-b830-f8318eb1f5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4631132d-2099-4587-8c1e-d98b96884907', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3969d4d-736f-4775-b8c5-fa5ea827724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:06 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Volume volume-4631132d-2099-4587-8c1e-d98b96884907 (4631132d-2099-4587-8c1e-d98b96884907): created successfully Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3969d4d-736f-4775-b8c5-fa5ea827724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Flow 'volume_create_manager' (1e2d3c1f-fa42-4bb2-b15c-67b419631d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-28b2a29b-bda2-4b54-bac9-49ae56f0aacb tempest-GroupsTest-1810280597 None] Created volume successfully. Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Flow 'volume_create_manager' (ef0cedc8-2f95-4528-8fd4-50c8c239fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7324c8d7-266b-4a3e-8256-f90af1e7642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7324c8d7-266b-4a3e-8256-f90af1e7642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870529896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d0c23ff-eded-4c85-93f6-683412552809,host='devstack@QuobyteHD#QuobyteHD',id=036d986e-83ac-4c08-90ea-e037a4133e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4cf98c42a24745a29b9cb52051b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:07Z,use_quota=True,user_id='8cad7ad9349643e3ad23e0941f7f94ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46299f59-79f6-4c25-a1ea-8c7c133e24d5),volume_type_id=46299f59-79f6-4c25-a1ea-8c7c133e24d5)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b946ba0-f0bf-40df-9979-8f531872382a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b946ba0-f0bf-40df-9979-8f531872382a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410d661e-4c1d-4f0d-b103-70d25932b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410d661e-4c1d-4f0d-b103-70d25932b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036d986e-83ac-4c08-90ea-e037a4133e91', 'volume_name': 'volume-036d986e-83ac-4c08-90ea-e037a4133e91', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fb8e2b-5372-4c6e-a9d2-d5ecf8a5c063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fb8e2b-5372-4c6e-a9d2-d5ecf8a5c063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e05975d-da15-4ab8-9646-8d59659931de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Volume 036d986e-83ac-4c08-90ea-e037a4133e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036d986e-83ac-4c08-90ea-e037a4133e91', 'volume_size': 1} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d0c23ff-eded-4c85-93f6-683412552809,created_at=2026-07-29T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870529896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d0c23ff-eded-4c85-93f6-683412552809,host='devstack@QuobyteHD#QuobyteHD',id=036d986e-83ac-4c08-90ea-e037a4133e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4cf98c42a24745a29b9cb52051b639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:07Z,use_quota=True,user_id='8cad7ad9349643e3ad23e0941f7f94ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46299f59-79f6-4c25-a1ea-8c7c133e24d5),volume_type_id=46299f59-79f6-4c25-a1ea-8c7c133e24d5)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Creating volume 036d986e-83ac-4c08-90ea-e037a4133e91 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:18:07 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:07 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 1073741824 Jul 29 16:18:07 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:07 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 1073741824" returned: 0 in 0.469s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:07 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 Jul 29 16:18:07 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:08 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91" returned: 0 in 0.265s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e05975d-da15-4ab8-9646-8d59659931de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036d986e-83ac-4c08-90ea-e037a4133e91', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70cc4d33-27a0-4ba6-9272-24bdff1c0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:08 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Volume volume-036d986e-83ac-4c08-90ea-e037a4133e91 (036d986e-83ac-4c08-90ea-e037a4133e91): created successfully Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70cc4d33-27a0-4ba6-9272-24bdff1c0834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Flow 'volume_create_manager' (ef0cedc8-2f95-4528-8fd4-50c8c239fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7632de8f-0859-4139-a727-c6937bc004e7 tempest-GroupsTest-1810280597 None] Created volume successfully. Jul 29 16:18:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7b5fc961-fbf7-4159-88f3-b448e0a8b839 tempest-GroupsTest-1810280597 None] Update group completed successfully. Jul 29 16:18:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-16f4fb9c-17c4-46c6-b53d-1b70830eb442 tempest-GroupsTest-1810280597 None] Update group completed successfully. Jul 29 16:18:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Acquiring lock "cinder-quobyte-036d986e-83ac-4c08-90ea-e037a4133e91" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Lock "cinder-quobyte-036d986e-83ac-4c08-90ea-e037a4133e91" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:11 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c8a753-e08d-4dd4-8c2b-bf30e73cbdf3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:11 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 Jul 29 16:18:11 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:12 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91" returned: 0 in 0.401s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:12 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91 Jul 29 16:18:12 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:18:12 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Flow 'volume_create_manager' (7529db27-1b5d-4e75-a0d4-01fc4a024a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38bec50-8c2d-4c44-9173-ce551e100db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-036d986e-83ac-4c08-90ea-e037a4133e91" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Lock "cinder-quobyte-036d986e-83ac-4c08-90ea-e037a4133e91" released by "delete_volume" :: held 0.797s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Acquiring lock "cinder-quobyte-4631132d-2099-4587-8c1e-d98b96884907" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38bec50-8c2d-4c44-9173-ce551e100db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-361612663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ef1a1d63194cadb379b3fbbeebb533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac0daf5b-4771-4b05-a452-6a94827dad5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:12Z,use_quota=True,user_id='a2eb1a4af269427bba8369f4851e0527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5890e44a-2834-4525-8cab-fadd623f9165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5890e44a-2834-4525-8cab-fadd623f9165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0b9341-0458-4e2f-93d9-810b872e76c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0b9341-0458-4e2f-93d9-810b872e76c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10', 'volume_name': 'volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10', 'volume_size': 1, 'snapshot_id': 'ac0daf5b-4771-4b05-a452-6a94827dad5d'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba80d12c-2fae-46e8-92d2-1d3276fc3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba80d12c-2fae-46e8-92d2-1d3276fc3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67134ba6-50fe-4f6c-802c-6f9d408d0dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Volume 3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10', 'volume_size': 1, 'snapshot_id': 'ac0daf5b-4771-4b05-a452-6a94827dad5d'} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Lock "cinder-quobyte-4631132d-2099-4587-8c1e-d98b96884907" acquired by "delete_volume" :: waited 0.061s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-quobyte-ac0daf5b-4771-4b05-a452-6a94827dad5d-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[161e8653-43c9-449e-87c1-c78a5acb859f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-ac0daf5b-4771-4b05-a452-6a94827dad5d-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Creating volume 3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 from snapshot ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-quobyte-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] snapshot: ac0daf5b-4771-4b05-a452-6a94827dad5d, volume: 3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6977355-70c8-422e-88fe-60dd966820fd]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:12 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 Jul 29 16:18:12 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:12 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d Jul 29 16:18:12 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:13 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907" returned: 0 in 0.480s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:13 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907 Jul 29 16:18:13 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:13 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d" returned: 0 in 0.452s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5631f1ef-aad7-4538-96ec-d0d22a092c38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73e67e-4f13-4568-afe4-692b0e21af1a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:13 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:18:13 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:13 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4631132d-2099-4587-8c1e-d98b96884907" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Lock "cinder-quobyte-4631132d-2099-4587-8c1e-d98b96884907" released by "delete_volume" :: held 0.858s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Created reservations ['ef9222b2-80e7-42eb-b964-c7aeb7efa8f3'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:13 devstack cinder-volume[88575]: WARNING cinder.quota [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1537062871 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1537062871, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:18:13 devstack cinder-volume[88575]: WARNING cinder.quota [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1537062871 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1537062871, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Created reservations ['e30e1a99-1791-4e42-a590-43a0171b50c9', 'a3a5cab4-83e0-4637-851f-93ffc971f3d3', '20dc54ab-b2e0-4c20-a562-4facfdaca299', 'c279003c-ee72-46b5-a18d-f6dd51e01f4c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:13 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.459s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:13 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 Jul 29 16:18:13 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Created reservations ['a9ace186-8d4d-4d90-ad36-326b51ddeb10', 'c1f9ebc9-1b74-4807-8e2c-f883224cdced', '6126fd86-c3ba-4958-9675-b5480e1a0f01', 'e9eb361c-c7d3-4100-b8f7-3da3a6049f07'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:13 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:18:13 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:14 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.345s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:14 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:18:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a901837b-d220-4f1f-acee-868cf9aaec3b tempest-GroupsTest-1810280597 None] Delete group completed successfully. Jul 29 16:18:20 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" returned: 0 in 6.998s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:20 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd9cd3-3c2e-43de-be75-f0dc8503ea4b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:20 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:18:20 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:21 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.806s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:18:21 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Converted 1024.00 MB image at 146.28 MB/s Jul 29 16:18:21 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 is being set with open permissions: ugo+rw Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:21 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 Jul 29 16:18:21 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:21 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" returned: 0 in 0.457s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" released by "_copy_volume_from_snapshot" :: held 9.295s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-ac0daf5b-4771-4b05-a452-6a94827dad5d-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" released by "_create_volume_from_snapshot" :: held 9.343s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.376s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67134ba6-50fe-4f6c-802c-6f9d408d0dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10', 'volume_size': 1, 'snapshot_id': 'ac0daf5b-4771-4b05-a452-6a94827dad5d'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b007f-504b-4f01-9a3e-23c3f89925dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Volume volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 (3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10): created successfully Jul 29 16:18:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b007f-504b-4f01-9a3e-23c3f89925dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Flow 'volume_create_manager' (7529db27-1b5d-4e75-a0d4-01fc4a024a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2955c98e-8848-4d0d-a140-60ce6607b191 tempest-TestStampPattern-1595417922 None] Created volume successfully. Jul 29 16:18:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f38c3d39-1fa2-4e50-be55-95a80b3f1de9 tempest-GroupsV314Test-1045902065 None] Group tempest-GroupsV314Test-Group-1262714267: creating Jul 29 16:18:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f38c3d39-1fa2-4e50-be55-95a80b3f1de9 tempest-GroupsV314Test-1045902065 None] Group tempest-GroupsV314Test-Group-1262714267: created successfully Jul 29 16:18:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f38c3d39-1fa2-4e50-be55-95a80b3f1de9 tempest-GroupsV314Test-1045902065 None] Create group completed successfully. Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Flow 'volume_create_manager' (e61192cf-e5d4-4745-9bdb-75b41e101fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab48030f-9c11-46b5-bf2e-2e0c1c315172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab48030f-9c11-46b5-bf2e-2e0c1c315172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109996530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43a821d8-b099-4fab-8008-2ff0dcc12d28,host='devstack@QuobyteHD#QuobyteHD',id=fda19569-993c-40e5-8d4f-315839512391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a85a409b264a24a976ef3fe9ccd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:27Z,use_quota=True,user_id='9a14edd98f7948caa1a9a1bde7001fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a5a0e93-6d27-4c90-930e-5a6302f92704),volume_type_id=4a5a0e93-6d27-4c90-930e-5a6302f92704)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c83e83-0a3e-422e-b27f-89cdd23e1720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c83e83-0a3e-422e-b27f-89cdd23e1720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c297bfdb-f64c-4c50-b0d0-b5fc80913fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c297bfdb-f64c-4c50-b0d0-b5fc80913fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda19569-993c-40e5-8d4f-315839512391', 'volume_name': 'volume-fda19569-993c-40e5-8d4f-315839512391', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e40bfe-b1ae-4841-bafa-bbbd8c4ba676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e40bfe-b1ae-4841-bafa-bbbd8c4ba676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e20322c-b829-4d46-8b01-e8bd37ca3970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Volume fda19569-993c-40e5-8d4f-315839512391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda19569-993c-40e5-8d4f-315839512391', 'volume_size': 1} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43a821d8-b099-4fab-8008-2ff0dcc12d28,created_at=2026-07-29T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109996530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43a821d8-b099-4fab-8008-2ff0dcc12d28,host='devstack@QuobyteHD#QuobyteHD',id=fda19569-993c-40e5-8d4f-315839512391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a85a409b264a24a976ef3fe9ccd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:27Z,use_quota=True,user_id='9a14edd98f7948caa1a9a1bde7001fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a5a0e93-6d27-4c90-930e-5a6302f92704),volume_type_id=4a5a0e93-6d27-4c90-930e-5a6302f92704)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Creating volume fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:18:26 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:18:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:26 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 1073741824 Jul 29 16:18:26 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:27 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 1073741824" returned: 0 in 0.602s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:27 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:27 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:27 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.301s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e20322c-b829-4d46-8b01-e8bd37ca3970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda19569-993c-40e5-8d4f-315839512391', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d1047f-5ef7-4ebd-ab02-75ceb045a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:27 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Volume volume-fda19569-993c-40e5-8d4f-315839512391 (fda19569-993c-40e5-8d4f-315839512391): created successfully Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d1047f-5ef7-4ebd-ab02-75ceb045a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:27 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Flow 'volume_create_manager' (e61192cf-e5d4-4745-9bdb-75b41e101fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:27 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8a3ff3a5-1ca5-49fd-bf34-703d48b14fda tempest-GroupsV314Test-1045902065 None] Created volume successfully. Jul 29 16:18:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:28 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Cloning volume fda19569-993c-40e5-8d4f-315839512391 to volume 181459d9-ee41-4ce4-a5b3-2991d692bb20 Jul 29 16:18:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Creating offline snapshot 4e03a35c-68b1-4b85-9242-11280ff4c5e1 of volume fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:18:28 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bc6a79-832a-4300-b2a3-4f34db273fcd]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:29 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:29 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:29 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.545s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:29 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 1G Jul 29 16:18:29 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:29 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 1G" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda19569-993c-40e5-8d4f-315839512391 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:29 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda19569-993c-40e5-8d4f-315839512391 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 Jul 29 16:18:29 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:30 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda19569-993c-40e5-8d4f-315839512391 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1" returned: 0 in 0.332s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:30 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:30 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 Jul 29 16:18:30 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:30 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:30 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info Jul 29 16:18:30 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:30 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info" returned: 0 in 0.257s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:30 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:30 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info Jul 29 16:18:30 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:30 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.info" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Acquiring lock "cinder-quobyte-181459d9-ee41-4ce4-a5b3-2991d692bb20" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-181459d9-ee41-4ce4-a5b3-2991d692bb20" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] snapshot: 4e03a35c-68b1-4b85-9242-11280ff4c5e1, volume: 181459d9-ee41-4ce4-a5b3-2991d692bb20, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9bc4d1-51c8-4c48-ac2c-ee6c24840273]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:31 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 Jul 29 16:18:31 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:31 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1" returned: 0 in 0.396s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda19569-993c-40e5-8d4f-315839512391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5430aa62-0115-4394-a5b6-acd005e5e6ce]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:31 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:31 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:31 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.392s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:18:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:31 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 Jul 29 16:18:31 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:36 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:18:36 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:37 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.903s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:18:37 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20" returned: 0 in 5.822s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b591a0-23e2-46c7-9abc-eed6598c94a3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:37 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:37 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:38 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.585s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:18:38 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Converted 1024.00 MB image at 175.86 MB/s Jul 29 16:18:38 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 is being set with open permissions: ugo+rw: NotImplementedError Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:38 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 Jul 29 16:18:38 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:38 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-181459d9-ee41-4ce4-a5b3-2991d692bb20" released by "_copy_volume_from_snapshot" :: held 7.572s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Acquiring lock "cinder-quobyte-4e03a35c-68b1-4b85-9242-11280ff4c5e1" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-4e03a35c-68b1-4b85-9242-11280ff4c5e1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Deleting offline snapshot 4e03a35c-68b1-4b85-9242-11280ff4c5e1 of volume fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] snapshot_file for this snap is: volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[67942084-60ec-4cfc-9719-c5b6fd1af93c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:38 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 Jul 29 16:18:38 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:39 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1" returned: 0 in 0.381s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda19569-993c-40e5-8d4f-315839512391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebd114a-b661-4916-9b9d-764459f19dd3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:39 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:39 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:39 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.390s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:39 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 Jul 29 16:18:39 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:39 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1" returned: 0 in 0.381s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:39 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1 Jul 29 16:18:39 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:40 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391.4e03a35c-68b1-4b85-9242-11280ff4c5e1" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-4e03a35c-68b1-4b85-9242-11280ff4c5e1" released by "_delete_snapshot" :: held 1.513s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.470s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c1fa3acd-2b88-44a8-ab57-9ed4f208814c tempest-GroupsV314Test-1045902065 None] Create group from source-group-43a821d8-b099-4fab-8008-2ff0dcc12d28 completed successfully. Jul 29 16:18:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Acquiring lock "cinder-quobyte-181459d9-ee41-4ce4-a5b3-2991d692bb20" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-181459d9-ee41-4ce4-a5b3-2991d692bb20" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398e737-a3db-48e9-a003-1b24c0f4e7c8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:41 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 Jul 29 16:18:41 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:41 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20" returned: 0 in 0.393s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:42 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20 Jul 29 16:18:42 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:42 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-181459d9-ee41-4ce4-a5b3-2991d692bb20" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-181459d9-ee41-4ce4-a5b3-2991d692bb20" released by "delete_volume" :: held 0.719s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Created reservations ['66071e69-3444-4c97-950a-38faa69c1114'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:42 devstack cinder-volume[88575]: WARNING cinder.quota [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1963280287 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1963280287, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:18:42 devstack cinder-volume[88575]: WARNING cinder.quota [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1963280287 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1963280287, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Created reservations ['d27c3add-52cd-417d-b96d-d5e230101c1d', 'adb5b4bf-1c86-4a0b-9426-58f511e924cb', 'c64322d2-5632-4419-befa-bc728d167cf1', '04327508-4873-48e4-962a-c3d30145567b'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:42 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:18:42 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:42 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.279s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:42 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:18:42 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c58e1018-d685-4c10-a519-5560f45139b6 tempest-GroupsV314Test-1045902065 None] Delete group completed successfully. Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Acquiring lock "cinder-quobyte-fda19569-993c-40e5-8d4f-315839512391" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-fda19569-993c-40e5-8d4f-315839512391" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fdd78-7b70-4f9b-bc53-6ba87b094b32]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:43 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:43 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:43 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:43 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391 Jul 29 16:18:43 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:43 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fda19569-993c-40e5-8d4f-315839512391" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Lock "cinder-quobyte-fda19569-993c-40e5-8d4f-315839512391" released by "delete_volume" :: held 0.733s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Created reservations ['53b81ded-966a-481c-9c9f-33b2a63c82e5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Created reservations ['6f7466cc-3b8e-44b3-8705-2a4d39338705', '4c965502-c447-4947-a716-ed560234b5c0', '1de705fc-4c39-485b-a3ea-67ab28491c41', '26890a66-a29c-4f34-9d89-0354c5988ecf'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:44 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:18:44 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:44 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:18:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2ba28ee7-9106-403e-80e2-8da502d0eb45 tempest-GroupsV314Test-1045902065 None] Delete group completed successfully. Jul 29 16:18:54 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=87,cinder:UPDATE=84,cinder:INSERT=13,cinder:DELETE=5 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:18:54 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=84,cinder:UPDATE=75,cinder:INSERT=19,cinder:DELETE=1 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Flow 'volume_create_manager' (f330dfd5-43fd-4327-beb3-7b14eb9f4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0aa723d-47b7-4db2-baaf-778b5b4d07fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0aa723d-47b7-4db2-baaf-778b5b4d07fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-600356873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1bfc77-457e-46ef-a30a-d56e3936544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab08ef2b679b4521b2856850e575175a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:56Z,use_quota=True,user_id='96859fa55061465b978718d5e1881ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6b4d0a-6633-4727-ab15-486609078141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6b4d0a-6633-4727-ab15-486609078141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf652d2-cfee-4027-b1ef-59f9464225e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf652d2-cfee-4027-b1ef-59f9464225e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1bfc77-457e-46ef-a30a-d56e3936544a', 'volume_name': 'volume-fc1bfc77-457e-46ef-a30a-d56e3936544a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1ac865-5b19-4ab8-88cd-b4a729e49113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1ac865-5b19-4ab8-88cd-b4a729e49113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595dd010-29ae-444c-b9af-8c9eacdf324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:56 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Volume fc1bfc77-457e-46ef-a30a-d56e3936544a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1bfc77-457e-46ef-a30a-d56e3936544a', 'volume_size': 1} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-600356873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1bfc77-457e-46ef-a30a-d56e3936544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab08ef2b679b4521b2856850e575175a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:18:56Z,use_quota=True,user_id='96859fa55061465b978718d5e1881ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Creating volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:18:56 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:56 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a 1073741824 Jul 29 16:18:56 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:56 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a 1073741824" returned: 0 in 0.472s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:56 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a Jul 29 16:18:56 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:57 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595dd010-29ae-444c-b9af-8c9eacdf324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1bfc77-457e-46ef-a30a-d56e3936544a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1551719d-0b21-43f4-ae03-ec866ad0820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:18:57 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Volume volume-fc1bfc77-457e-46ef-a30a-d56e3936544a (fc1bfc77-457e-46ef-a30a-d56e3936544a): created successfully Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1551719d-0b21-43f4-ae03-ec866ad0820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:18:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Flow 'volume_create_manager' (f330dfd5-43fd-4327-beb3-7b14eb9f4150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:18:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-68d958b3-eb37-4687-bf3b-4d170899cd32 tempest-SnapshotsActionsTest-2020563503 None] Created volume successfully. Jul 29 16:18:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:18:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:18:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Creating offline snapshot 802272fe-0311-4903-af45-7a1b3d77c041 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:18:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6496d64f-cf12-4314-836b-8fec3ce53462]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:18:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:58 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a Jul 29 16:18:58 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:59 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a" returned: 0 in 0.387s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:59 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 1G Jul 29 16:18:59 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:59 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 1G" returned: 0 in 0.433s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:59 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:18:59 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:18:59 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jul 29 16:18:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.311s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:18:59 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 is being set with open permissions: ugo+rw Jul 29 16:18:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:18:59 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:18:59 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:00 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.263s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:00 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info Jul 29 16:19:00 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:00 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:00 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info is being set with open permissions: ugo+rw Jul 29 16:19:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:00 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info Jul 29 16:19:00 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:00 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.info" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b818f6c7-4f40-4c45-a8b8-537c7ba9ecea tempest-SnapshotsActionsTest-2020563503 None] Create snapshot completed successfully Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Creating offline snapshot 945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc52b6-53e2-4cce-82ce-f10320781180]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:02 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:02 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:02 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:02 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a 1G Jul 29 16:19:02 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:03 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a 1G" returned: 0 in 0.476s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:03 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a Jul 29 16:19:03 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:03 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" returned: 0 in 0.285s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:03 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a is being set with open permissions: ugo+rw Jul 29 16:19:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:03 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a Jul 29 16:19:03 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:03 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" returned: 0 in 0.256s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.509s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-182abb6b-6f66-40ed-954e-552b9ae0c217 tempest-SnapshotsActionsTest-2020563503 None] Create snapshot completed successfully Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Deleting offline snapshot 945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] snapshot_file for this snap is: volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0514666-2c0c-4135-8861-a60ba9372737]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:04 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a Jul 29 16:19:04 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:04 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd3c93-a006-4bb7-99bf-320d1102ce2a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:05 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:05 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:05 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.383s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:05 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a Jul 29 16:19:05 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:05 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" returned: 0 in 0.478s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:05 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a Jul 29 16:19:05 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:06 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" returned: 0 in 0.297s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a" released by "_delete_snapshot" :: held 1.629s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" released by "delete_snapshot" :: held 1.653s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Created reservations ['9685aeb8-518d-4d2b-9294-2049da5e7b84', 'e4ee5cd4-88a7-45b6-bf8f-8b4374c3e804', '3a55f795-66bb-4d14-b0b9-d90579ebb273', 'e28d0ed6-75c3-41a5-8603-95908f15d7ca'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e07d6-118d-45e5-a1fb-af1b228a23a0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Delete snapshot completed successfully. Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8889d012-2939-4b9e-9837-e35a4379636b tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-945fbe13-3b3c-4f98-b6b4-c8cb72d4f04a-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:06 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 Jul 29 16:19:06 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:06 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" returned: 0 in 0.393s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.430s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:06 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601', 'name': 'volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c0d0c82-935d-4703-a8c4-647207e8166a', 'enforce_multipath': True} {{(pid=88575) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 29 16:19:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-52a8b46d-1695-4002-9200-0207a03b14de req-11b5f6b7-ac8e-4d45-9c28-96b54d6e14af tempest-TestStampPattern-1595417922 None] attachment_update completed successfully. Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Creating offline snapshot 87108cf2-a497-4678-bfd3-c247aba96872 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[362bb698-c43a-428e-adb3-378d097f7040]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:07 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:07 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:07 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.447s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:07 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 1G Jul 29 16:19:07 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:08 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 1G" returned: 0 in 0.495s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:08 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 Jul 29 16:19:08 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:08 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872" returned: 0 in 0.307s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:08 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 is being set with open permissions: ugo+rw Jul 29 16:19:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:08 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 Jul 29 16:19:08 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:08 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e3419460-bc06-4c4d-9bec-f015312e3ffb tempest-SnapshotsActionsTest-2020563503 None] Create snapshot completed successfully Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-87108cf2-a497-4678-bfd3-c247aba96872-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-87108cf2-a497-4678-bfd3-c247aba96872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-87108cf2-a497-4678-bfd3-c247aba96872" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-87108cf2-a497-4678-bfd3-c247aba96872" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Deleting offline snapshot 87108cf2-a497-4678-bfd3-c247aba96872 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] snapshot_file for this snap is: volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d446e-6c7f-47a6-b1ba-ef03978532fe]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:09 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 Jul 29 16:19:09 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:09 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [req-f867e31d-627b-4f7d-b5cb-0a3722358007 req-a6e93a7a-9ab5-4aa5-b440-8683aa03e241 tempest-TestStampPattern-1595417922 None] Terminate volume connection completed successfully. Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [req-f867e31d-627b-4f7d-b5cb-0a3722358007 req-a6e93a7a-9ab5-4aa5-b440-8683aa03e241 tempest-TestStampPattern-1595417922 None] Deleting attachment 1c0d0c82-935d-4703-a8c4-647207e8166a. {{(pid=88575) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872" returned: 0 in 0.418s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[366e20ea-c120-444f-8d63-e947bfeea869]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:09 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:09 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:10 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.392s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:10 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 Jul 29 16:19:10 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:10 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872" returned: 0 in 0.421s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:10 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872 Jul 29 16:19:10 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:10 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87108cf2-a497-4678-bfd3-c247aba96872" returned: 0 in 0.255s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-87108cf2-a497-4678-bfd3-c247aba96872" released by "_delete_snapshot" :: held 1.605s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" released by "delete_snapshot" :: held 1.636s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:11 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Created reservations ['2fa95c32-a9be-4967-bbce-9bc26b4008d8', '023271cb-b74c-45a8-87fe-667175ada820', 'b46db977-bbba-4205-b1f5-9abff627b90d', '02c30fa0-9c98-4c2d-acb0-f33f356af767'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Delete snapshot completed successfully. Jul 29 16:19:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d6970067-7752-43e0-8576-1583b8634058 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-87108cf2-a497-4678-bfd3-c247aba96872-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Creating offline snapshot b70a2791-eb76-4bdc-a37d-d7cde594ec76 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:19:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddb6db8-5198-41ef-90d5-6105b6ad64c6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:12 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:12 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:12 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.447s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:12 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 1G Jul 29 16:19:12 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:13 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 1G" returned: 0 in 0.613s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:13 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 Jul 29 16:19:13 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:13 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76" returned: 0 in 0.323s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:13 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 is being set with open permissions: ugo+rw Jul 29 16:19:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:13 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 Jul 29 16:19:13 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:13 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:13 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-afd81f56-866d-45f3-be9c-5ff08f436086 tempest-SnapshotsActionsTest-2020563503 None] Create snapshot completed successfully Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-b70a2791-eb76-4bdc-a37d-d7cde594ec76-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-b70a2791-eb76-4bdc-a37d-d7cde594ec76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-b70a2791-eb76-4bdc-a37d-d7cde594ec76" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-b70a2791-eb76-4bdc-a37d-d7cde594ec76" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Deleting offline snapshot b70a2791-eb76-4bdc-a37d-d7cde594ec76 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] snapshot_file for this snap is: volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f0e7f-e537-4168-846b-fd36e6b9caf3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Lock "cinder-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-quobyte-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:14 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 Jul 29 16:19:14 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4027bd8-594e-4e5a-80ec-805770745fcd]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:14 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 Jul 29 16:19:14 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:14 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76" returned: 0 in 0.385s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e9096-46e8-4c71-92e8-09010187dae1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:14 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" returned: 0 in 0.374s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:14 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:14 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10 Jul 29 16:19:14 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:14 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:14 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" returned: 0 in 0.248s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10" released by "delete_volume" :: held 0.666s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:14 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.383s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:14 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 Jul 29 16:19:14 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Created reservations ['cb9d4c26-d334-4770-96e0-1809364a5e7e', '5f04519e-7e49-4966-8c4f-94d5be98b485', '5e77cc21-561a-4968-939d-ca21c57fd30c', '75538c97-c47d-49a4-a331-a16b195ef72a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:15 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:15 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:15 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:15 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76 Jul 29 16:19:15 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:15 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Deleted volume successfully. Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c97950b3-eda9-4ab8-9f50-cb57876ce8e6 tempest-TestStampPattern-1595417922 None] Lock "cinder-3d2bf17a-b9b6-4a93-a1cb-9e8a63a07e10-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:15 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.b70a2791-eb76-4bdc-a37d-d7cde594ec76" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-b70a2791-eb76-4bdc-a37d-d7cde594ec76" released by "_delete_snapshot" :: held 1.526s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" released by "delete_snapshot" :: held 1.551s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-ac0daf5b-4771-4b05-a452-6a94827dad5d-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Lock "cinder-ac0daf5b-4771-4b05-a452-6a94827dad5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-quobyte-5631f1ef-aad7-4538-96ec-d0d22a092c38" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-5631f1ef-aad7-4538-96ec-d0d22a092c38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-quobyte-ac0daf5b-4771-4b05-a452-6a94827dad5d" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-ac0daf5b-4771-4b05-a452-6a94827dad5d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Deleting offline snapshot ac0daf5b-4771-4b05-a452-6a94827dad5d of volume 5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] snapshot_file for this snap is: volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Created reservations ['40e8046e-7ec2-4cb3-b7ca-0a88d3f7abc1', 'b5e82443-097a-48a1-9dcc-ca5690dd3875', '36739e68-98b1-496d-b9e1-f9f986454425', '3019d356-63aa-4e48-8205-3ceb78724086'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8663540f-fff3-4c7f-8e9e-ef79ed474223]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Delete snapshot completed successfully. Jul 29 16:19:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-01430fa8-e87d-42da-bd4d-80073b7b3669 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-b70a2791-eb76-4bdc-a37d-d7cde594ec76-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:15 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d Jul 29 16:19:15 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:16 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d" returned: 0 in 0.364s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5631f1ef-aad7-4538-96ec-d0d22a092c38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[100940c5-ee37-4a86-aac4-8aa05812be35]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:16 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:19:16 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Creating offline snapshot 87c953e4-b130-4aaf-8270-930093154662 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:19:16 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d6964b-cbee-4d95-be01-3d1f3b663fa5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:16 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d Jul 29 16:19:16 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:16 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:16 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:16 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:16 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d Jul 29 16:19:16 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:16 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:16 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 1G Jul 29 16:19:16 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:17 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38.ac0daf5b-4771-4b05-a452-6a94827dad5d" returned: 0 in 0.259s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-ac0daf5b-4771-4b05-a452-6a94827dad5d" released by "_delete_snapshot" :: held 1.447s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-5631f1ef-aad7-4538-96ec-d0d22a092c38" released by "delete_snapshot" :: held 1.474s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Created reservations ['ebf88812-bc79-4b2e-8736-1ca87634dc49', '8623c627-80a2-4de0-b596-296875ac141c', '5416cafd-dd72-40c5-acdd-ebf0834efa55', 'da3345e0-0d2d-43bc-9ecf-f4306a519f0d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Delete snapshot completed successfully. Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e663ab62-e854-4f53-818e-dea04132198f tempest-TestStampPattern-1595417922 None] Lock "cinder-ac0daf5b-4771-4b05-a452-6a94827dad5d-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:17 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 1G" returned: 0 in 0.450s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:17 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 Jul 29 16:19:17 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:17 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662" returned: 0 in 0.304s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:17 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 is being set with open permissions: ugo+rw Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:17 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 Jul 29 16:19:17 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:17 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662" returned: 0 in 0.263s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.488s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6c45f381-a30a-44e9-81a5-d6bdd40316d3 tempest-SnapshotsActionsTest-2020563503 None] Create snapshot completed successfully Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-87c953e4-b130-4aaf-8270-930093154662-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-87c953e4-b130-4aaf-8270-930093154662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Acquiring lock "cinder-quobyte-87c953e4-b130-4aaf-8270-930093154662" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-87c953e4-b130-4aaf-8270-930093154662" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Deleting offline snapshot 87c953e4-b130-4aaf-8270-930093154662 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] snapshot_file for this snap is: volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0da544-b428-4bbe-93d4-2b225dc56e10]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:19 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 Jul 29 16:19:19 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:19 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662" returned: 0 in 0.507s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbbd57c-dac9-475e-8bfb-32d39d6fabf8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:19 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:19 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:19 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:19 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 Jul 29 16:19:19 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:20 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662" returned: 0 in 0.514s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:20 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662 Jul 29 16:19:20 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:20 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.87c953e4-b130-4aaf-8270-930093154662" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-87c953e4-b130-4aaf-8270-930093154662" released by "_delete_snapshot" :: held 1.838s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" released by "delete_snapshot" :: held 1.869s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Created reservations ['3ffc323d-933f-4391-84b2-28dbf0926cb2', 'a42fc162-a51b-4d0e-9e23-746a7661023d', '97eadd23-80d0-4c8b-ba0e-23e979429002', 'efa9e570-9686-466f-b1d7-495efd7ea89f'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Delete snapshot completed successfully. Jul 29 16:19:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2dd1e46d-b7da-4402-af90-4a3d360a7346 tempest-SnapshotsActionsTest-68041999 None] Lock "cinder-87c953e4-b130-4aaf-8270-930093154662-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "cinder-802272fe-0311-4903-af45-7a1b3d77c041-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-802272fe-0311-4903-af45-7a1b3d77c041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "cinder-quobyte-802272fe-0311-4903-af45-7a1b3d77c041" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-quobyte-802272fe-0311-4903-af45-7a1b3d77c041" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Deleting offline snapshot 802272fe-0311-4903-af45-7a1b3d77c041 of volume fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] snapshot_file for this snap is: volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d549c59d-c44e-4e14-b628-24b56f7f44a4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-5631f1ef-aad7-4538-96ec-d0d22a092c38-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Lock "cinder-5631f1ef-aad7-4538-96ec-d0d22a092c38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:21 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Acquiring lock "cinder-quobyte-5631f1ef-aad7-4538-96ec-d0d22a092c38" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:21 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-5631f1ef-aad7-4538-96ec-d0d22a092c38" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c74f51-3cee-4620-96c8-c45297647753]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:21 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:19:21 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:21 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc1bfc77-457e-46ef-a30a-d56e3936544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cddd056-e36a-41c1-a56d-40dcd587dd20]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:21 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a Jul 29 16:19:21 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:21 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.370s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:21 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38 Jul 29 16:19:21 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:22 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a" returned: 0 in 0.370s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:22 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:22 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5631f1ef-aad7-4538-96ec-d0d22a092c38" returned: 0 in 0.255s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:22 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Lock "cinder-quobyte-5631f1ef-aad7-4538-96ec-d0d22a092c38" released by "delete_volume" :: held 0.693s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Created reservations ['39b6d14c-63ea-4ec9-93db-0aecbd10836f', '10767c6b-ea8e-49ba-8cfa-e4ef644f69f3', '18aab7a2-2f5c-48f7-b973-1dbfaab764d6', '01225cd0-bac2-403c-b874-5a5b4d4f287c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:22 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:22 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:22 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.352s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:22 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041 Jul 29 16:19:22 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:22 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Deleted volume successfully. Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bebf4a37-56c7-4e70-a26b-94bac3e7ddec tempest-TestStampPattern-1595417922 None] Lock "cinder-5631f1ef-aad7-4538-96ec-d0d22a092c38-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:22 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a.802272fe-0311-4903-af45-7a1b3d77c041" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-quobyte-802272fe-0311-4903-af45-7a1b3d77c041" released by "_delete_snapshot" :: held 1.540s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" released by "delete_snapshot" :: held 1.568s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:22 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Created reservations ['c885dd45-70ce-4e38-a77a-b4206987936b', '7b480f26-7a9c-4b16-b129-4e0e1ed1d276', 'ced690ba-c92f-47f0-ab54-a788309e4221', '6de8a646-4cbe-4063-bea4-f532faaa92aa'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Delete snapshot completed successfully. Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71c07b8b-9cfa-4922-a3b2-84e5a8f8d156 tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-802272fe-0311-4903-af45-7a1b3d77c041-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "cinder-fc1bfc77-457e-46ef-a30a-d56e3936544a-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-fc1bfc77-457e-46ef-a30a-d56e3936544a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d89c1f2-ead1-4d9b-aea5-9641f09619e8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:23 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a Jul 29 16:19:23 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:24 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a" returned: 0 in 0.419s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:24 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a Jul 29 16:19:24 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:24 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc1bfc77-457e-46ef-a30a-d56e3936544a" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-quobyte-fc1bfc77-457e-46ef-a30a-d56e3936544a" released by "delete_volume" :: held 0.740s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Created reservations ['19b1aacd-6a33-4af2-90ca-acb7d2b57523', 'cac851b0-0d0f-43e0-bb94-5be6de3c2c10', '1225c6aa-8bb4-46b2-bacb-b94bf7443afd', '19466b60-e365-4c74-93fd-7c141e4b55af'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:24 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:24 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:24 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.303s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Deleted volume successfully. Jul 29 16:19:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68cf8824-ed7b-4f1b-9154-e65cac8f58ad tempest-SnapshotsActionsTest-2020563503 None] Lock "cinder-fc1bfc77-457e-46ef-a30a-d56e3936544a-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=61,cinder:SELECT=72,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (ab682b13-ca30-4275-b1a1-9838a07926e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292c7e7c-c5db-45f8-bbd8-e901ae392f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292c7e7c-c5db-45f8-bbd8-e901ae392f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-136720922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd4bfeb-012c-472d-83a1-c8879192add8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:35Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e2cfee-f9cd-4ea7-978e-fc20e00a8f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e2cfee-f9cd-4ea7-978e-fc20e00a8f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644969c2-8da3-4a70-9539-c0bdc4ba9a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644969c2-8da3-4a70-9539-c0bdc4ba9a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd4bfeb-012c-472d-83a1-c8879192add8', 'volume_name': 'volume-0fd4bfeb-012c-472d-83a1-c8879192add8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccf0840-9fc2-4e83-996b-7493d805527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccf0840-9fc2-4e83-996b-7493d805527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6b1477-efa7-40b0-bea5-a6682e4a8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:34 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume 0fd4bfeb-012c-472d-83a1-c8879192add8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd4bfeb-012c-472d-83a1-c8879192add8', 'volume_size': 1} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-136720922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd4bfeb-012c-472d-83a1-c8879192add8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:35Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Creating volume 0fd4bfeb-012c-472d-83a1-c8879192add8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:34 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:34 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 1073741824 Jul 29 16:19:34 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:35 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 1073741824" returned: 0 in 0.472s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:35 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 Jul 29 16:19:35 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:35 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8" returned: 0 in 0.257s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6b1477-efa7-40b0-bea5-a6682e4a8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd4bfeb-012c-472d-83a1-c8879192add8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4328b9-de3e-4350-9e32-d08742f43671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:35 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume volume-0fd4bfeb-012c-472d-83a1-c8879192add8 (0fd4bfeb-012c-472d-83a1-c8879192add8): created successfully Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4328b9-de3e-4350-9e32-d08742f43671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (ab682b13-ca30-4275-b1a1-9838a07926e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-59b8a17a-194c-4820-90a8-0e60b895bee4 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created volume successfully. Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:36 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:36 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:37 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.299s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (8e3a3b74-41cc-43f6-acf2-50daabb855f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67473cb1-d703-4e85-b132-0533706dd81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67473cb1-d703-4e85-b132-0533706dd81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129072288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:37Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278b57cd-cca9-4a9e-9fd0-08e98073135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278b57cd-cca9-4a9e-9fd0-08e98073135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19104504-8b0e-4932-8a01-e91287aa88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19104504-8b0e-4932-8a01-e91287aa88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1', 'volume_name': 'volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb2288a-15bd-4fcf-80f6-230b5f909ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb2288a-15bd-4fcf-80f6-230b5f909ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f8f7c0-ed31-4d46-85e7-166c4ab9ecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1', 'volume_size': 1} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129072288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:37Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Creating volume b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:37 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:37 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 1073741824 Jul 29 16:19:37 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (f5c41a7e-adfa-4c55-8ab1-276bd6ef2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3245aee3-364f-4a0b-90f9-75a0a78e431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3245aee3-364f-4a0b-90f9-75a0a78e431b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261718539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97561d00-c96a-4f58-979e-883917350a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:38Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94157816-4404-4ad4-9641-f233365ce895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94157816-4404-4ad4-9641-f233365ce895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e65faa3-f1d2-4583-814c-3fa0460c64b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e65faa3-f1d2-4583-814c-3fa0460c64b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97561d00-c96a-4f58-979e-883917350a9b', 'volume_name': 'volume-97561d00-c96a-4f58-979e-883917350a9b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17bc5aa-e105-4329-ad8b-793d946d3601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17bc5aa-e105-4329-ad8b-793d946d3601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3db0c4f-f665-4698-98c3-e429328dfead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume 97561d00-c96a-4f58-979e-883917350a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97561d00-c96a-4f58-979e-883917350a9b', 'volume_size': 1} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:37 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 1073741824" returned: 0 in 0.585s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:37 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 Jul 29 16:19:37 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (8a2a5352-8a5f-4b7a-912d-df15dfb33651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f095d6f-c1ca-469e-9e74-dc6d6104d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f095d6f-c1ca-469e-9e74-dc6d6104d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248091631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb115be-276b-4d7b-af86-7cf43e01f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:38Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a8f53c-1454-4841-9641-bab8f7e2bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a8f53c-1454-4841-9641-bab8f7e2bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74fcedc-2785-4e28-a035-6b10eab11782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74fcedc-2785-4e28-a035-6b10eab11782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb115be-276b-4d7b-af86-7cf43e01f682', 'volume_name': 'volume-efb115be-276b-4d7b-af86-7cf43e01f682', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89640681-48d1-458f-af28-993a42b78dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89640681-48d1-458f-af28-993a42b78dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cbb0d5-0c3b-4ff8-ab5f-0abcfa3b9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume efb115be-276b-4d7b-af86-7cf43e01f682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb115be-276b-4d7b-af86-7cf43e01f682', 'volume_size': 1} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:38 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1" returned: 0 in 0.412s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261718539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97561d00-c96a-4f58-979e-883917350a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:38Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Creating volume 97561d00-c96a-4f58-979e-883917350a9b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:38 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f8f7c0-ed31-4d46-85e7-166c4ab9ecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b 1073741824 Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e6e51b-beeb-42df-9964-a60314a7250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 (b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1): created successfully Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e6e51b-beeb-42df-9964-a60314a7250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (8e3a3b74-41cc-43f6-acf2-50daabb855f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-27f0f313-35a2-4423-a38b-f4429367e9f2 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created volume successfully. Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (c079db8e-8041-4249-acdb-338fa3aec32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f1133e-6019-48b1-b0de-782d07ecaefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f1133e-6019-48b1-b0de-782d07ecaefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1858540293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd23d657-05cb-47ab-bf77-474619ebf175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:38Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb879cd-e6d6-4d75-b7cb-4517faaa179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb879cd-e6d6-4d75-b7cb-4517faaa179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b72232-8ed4-4d27-a89d-893d19c7c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b72232-8ed4-4d27-a89d-893d19c7c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd23d657-05cb-47ab-bf77-474619ebf175', 'volume_name': 'volume-cd23d657-05cb-47ab-bf77-474619ebf175', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b34623b-d574-4eea-8668-4646bf3fd5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b34623b-d574-4eea-8668-4646bf3fd5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2779e83-28f6-4368-b862-3f2c1a9efb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume cd23d657-05cb-47ab-bf77-474619ebf175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd23d657-05cb-47ab-bf77-474619ebf175', 'volume_size': 1} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (b3776d8b-c39e-4781-aa14-54b76436d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596a014e-7f01-44c2-8b7c-8d3b3c1a7156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596a014e-7f01-44c2-8b7c-8d3b3c1a7156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835408188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:39Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bdecca-457e-4707-867e-857a15b428d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bdecca-457e-4707-867e-857a15b428d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f2bba5-8e13-4c84-87a5-4ce1e0689a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f2bba5-8e13-4c84-87a5-4ce1e0689a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8', 'volume_name': 'volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ced28f-b2e0-46ca-8a56-f398aa99d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ced28f-b2e0-46ca-8a56-f398aa99d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d1a8e4-15af-4b7f-8538-b49b46cb6fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume 44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8', 'volume_size': 1} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b 1073741824" returned: 0 in 0.600s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:39 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b Jul 29 16:19:39 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:39 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248091631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb115be-276b-4d7b-af86-7cf43e01f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:38Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Creating volume efb115be-276b-4d7b-af86-7cf43e01f682 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:39 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:39 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 1073741824 Jul 29 16:19:39 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3db0c4f-f665-4698-98c3-e429328dfead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97561d00-c96a-4f58-979e-883917350a9b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a476d003-4ea7-41e4-90bc-e1051f51847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:39 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume volume-97561d00-c96a-4f58-979e-883917350a9b (97561d00-c96a-4f58-979e-883917350a9b): created successfully Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a476d003-4ea7-41e4-90bc-e1051f51847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (f5c41a7e-adfa-4c55-8ab1-276bd6ef2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:39 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f6473b7c-5241-4acb-85d9-95812dbd2faf tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created volume successfully. Jul 29 16:19:39 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 1073741824" returned: 0 in 0.472s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:39 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 Jul 29 16:19:39 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Flow 'volume_create_manager' (c3c63930-3caa-4719-85a2-d7002dbbe3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a11b7d-2c09-4edd-abbb-66d82e3c68bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a11b7d-2c09-4edd-abbb-66d82e3c68bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-802455652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f62ab8-9818-42ec-ad23-569675a6f47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23960eb1dbc1406d944636631adaf326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:40Z,use_quota=True,user_id='d62851cf52db4207bfb29006a1050efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3648d833-5179-42de-919a-b4a44ab074b9),volume_type_id=3648d833-5179-42de-919a-b4a44ab074b9)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64feb5ce-5e31-4ab3-9ee9-0e76c2eb0b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64feb5ce-5e31-4ab3-9ee9-0e76c2eb0b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa9292c-bcac-4ffb-8706-7c2f70353833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa9292c-bcac-4ffb-8706-7c2f70353833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f62ab8-9818-42ec-ad23-569675a6f47e', 'volume_name': 'volume-d4f62ab8-9818-42ec-ad23-569675a6f47e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c57cfcd-9b9c-47b1-b619-dc9e6e240c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:39 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c57cfcd-9b9c-47b1-b619-dc9e6e240c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaf4da0-8497-4d66-9b67-cc8376882f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Volume d4f62ab8-9818-42ec-ad23-569675a6f47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f62ab8-9818-42ec-ad23-569675a6f47e', 'volume_size': 1} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:40 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1858540293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd23d657-05cb-47ab-bf77-474619ebf175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:38Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Creating volume cd23d657-05cb-47ab-bf77-474619ebf175 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cbb0d5-0c3b-4ff8-ab5f-0abcfa3b9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb115be-276b-4d7b-af86-7cf43e01f682', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:40 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 1073741824 Jul 29 16:19:40 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee650c5-1844-4ed4-8a48-6ac64b9c18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume volume-efb115be-276b-4d7b-af86-7cf43e01f682 (efb115be-276b-4d7b-af86-7cf43e01f682): created successfully Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee650c5-1844-4ed4-8a48-6ac64b9c18d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (8a2a5352-8a5f-4b7a-912d-df15dfb33651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a9863e1b-df8c-44f6-a6f9-1be1d6019fe0 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created volume successfully. Jul 29 16:19:40 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 1073741824" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:40 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 Jul 29 16:19:40 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:40 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175" returned: 0 in 0.242s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835408188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510d34ff4cae47ccabaccfdf1e9dc757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:39Z,use_quota=True,user_id='255f97683057420cb5fbbfa33e77623e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Creating volume 44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2779e83-28f6-4368-b862-3f2c1a9efb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd23d657-05cb-47ab-bf77-474619ebf175', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:40 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 1073741824 Jul 29 16:19:40 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384545ee-38b1-486f-bcdf-66cb9baff06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume volume-cd23d657-05cb-47ab-bf77-474619ebf175 (cd23d657-05cb-47ab-bf77-474619ebf175): created successfully Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384545ee-38b1-486f-bcdf-66cb9baff06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (c079db8e-8041-4249-acdb-338fa3aec32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a40ba097-fc4e-42f0-a41c-823fb092e281 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created volume successfully. Jul 29 16:19:41 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 1073741824" returned: 0 in 0.443s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:41 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 Jul 29 16:19:41 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:41 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8" returned: 0 in 0.234s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-802455652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f62ab8-9818-42ec-ad23-569675a6f47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23960eb1dbc1406d944636631adaf326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:40Z,use_quota=True,user_id='d62851cf52db4207bfb29006a1050efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3648d833-5179-42de-919a-b4a44ab074b9),volume_type_id=3648d833-5179-42de-919a-b4a44ab074b9)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Creating volume d4f62ab8-9818-42ec-ad23-569675a6f47e {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:41 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:41 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e 1073741824 Jul 29 16:19:41 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d1a8e4-15af-4b7f-8538-b49b46cb6fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189b83bb-d08e-4cf3-9c31-76137a02644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Volume volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 (44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8): created successfully Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189b83bb-d08e-4cf3-9c31-76137a02644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Flow 'volume_create_manager' (b3776d8b-c39e-4781-aa14-54b76436d481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8ca8e5d8-6138-44bc-af10-1babf4ac5a93 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created volume successfully. Jul 29 16:19:41 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e 1073741824" returned: 0 in 0.452s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:42 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e Jul 29 16:19:42 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:42 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaf4da0-8497-4d66-9b67-cc8376882f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f62ab8-9818-42ec-ad23-569675a6f47e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e42ada-0ec4-4639-a3e2-719afe958fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:42 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Volume volume-d4f62ab8-9818-42ec-ad23-569675a6f47e (d4f62ab8-9818-42ec-ad23-569675a6f47e): created successfully Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e42ada-0ec4-4639-a3e2-719afe958fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Flow 'volume_create_manager' (c3c63930-3caa-4719-85a2-d7002dbbe3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:42 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-aa4d87a3-c042-477d-92eb-f1381c32907c tempest-VolumeTypesAccessTest-622543151 None] Created volume successfully. Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-quobyte-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8" acquired by "delete_volume" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc18444-c34f-409b-927c-6f04eed4dd3a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:42 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 Jul 29 16:19:42 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:42 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8" returned: 0 in 0.349s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:42 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8 Jul 29 16:19:42 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:43 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8" returned: 0 in 0.255s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8" released by "delete_volume" :: held 0.646s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Acquiring lock "cinder-d4f62ab8-9818-42ec-ad23-569675a6f47e-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Lock "cinder-d4f62ab8-9818-42ec-ad23-569675a6f47e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created reservations ['263d68eb-cf70-4055-87c2-410e1cd06930', 'd326415c-6daa-42e1-8b14-b67d50ec1e04', '7db909de-a47e-4dfb-991e-6adbdd9b45d7', '10782125-53d3-4940-9487-263adea873be'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Acquiring lock "cinder-quobyte-d4f62ab8-9818-42ec-ad23-569675a6f47e" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Lock "cinder-quobyte-d4f62ab8-9818-42ec-ad23-569675a6f47e" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[489be2bf-97aa-4187-ae9b-009660a41b02]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:43 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:43 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:43 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e Jul 29 16:19:43 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-cd23d657-05cb-47ab-bf77-474619ebf175-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:43 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Deleted volume successfully. Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-cd23d657-05cb-47ab-bf77-474619ebf175-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f8f6d84c-1535-4e5b-adde-9889fa3bba86 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-44f5fa55-7b7d-42f1-a7d5-d9a1bdc006d8-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-quobyte-cd23d657-05cb-47ab-bf77-474619ebf175" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-cd23d657-05cb-47ab-bf77-474619ebf175" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:43 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e" returned: 0 in 0.432s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ae290-7f7f-4e29-8fa5-8841090abe57]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:43 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e Jul 29 16:19:43 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:43 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 Jul 29 16:19:43 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:43 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4f62ab8-9818-42ec-ad23-569675a6f47e" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Lock "cinder-quobyte-d4f62ab8-9818-42ec-ad23-569675a6f47e" released by "delete_volume" :: held 0.716s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:43 devstack cinder-volume[88575]: WARNING cinder.quota [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1773927499 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1773927499, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:19:43 devstack cinder-volume[88575]: WARNING cinder.quota [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1773927499 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1773927499, it is now deprecated. Please use the default quota class for default quota. Jul 29 16:19:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Created reservations ['c112e11f-a916-4191-9a3c-64c2108e4c65', '886f0c2f-79b3-4866-9ff8-c2bfd8427ea4', 'e758430d-6488-40b8-9eff-2699155b8711', '97cb0620-093d-4aa0-888b-0fda3b6ffe20'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:44 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175" returned: 0 in 0.380s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:44 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175 Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:44 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:44 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:44 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:44 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cd23d657-05cb-47ab-bf77-474619ebf175" returned: 0 in 0.265s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-cd23d657-05cb-47ab-bf77-474619ebf175" released by "delete_volume" :: held 0.701s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:44 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.297s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Deleted volume successfully. Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created reservations ['dc8bbedd-ed5f-4043-aca3-4ac880aa58ea', 'ee665059-4630-4b23-8b0f-3e8a192dbb2d', '610df96b-22a7-4177-9e74-b160a9f84626', 'c158ffd0-b46b-4b17-85dc-2e3abd384009'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-633c0a9f-08b8-47ec-bc7e-1d30ceed46da tempest-VolumeTypesAccessTest-622543151 None] Lock "cinder-d4f62ab8-9818-42ec-ad23-569675a6f47e-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:44 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:44 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-efb115be-276b-4d7b-af86-7cf43e01f682-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-efb115be-276b-4d7b-af86-7cf43e01f682-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:44 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-quobyte-efb115be-276b-4d7b-af86-7cf43e01f682" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Deleted volume successfully. Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-efb115be-276b-4d7b-af86-7cf43e01f682" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5deac1d5-eb2a-43d2-a441-1b165fe4e0ab tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-cd23d657-05cb-47ab-bf77-474619ebf175-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee1a7ed-df68-412e-84b8-5e2b5b7cff13]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:44 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 Jul 29 16:19:44 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:45 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:45 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682 Jul 29 16:19:45 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:45 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-efb115be-276b-4d7b-af86-7cf43e01f682" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-efb115be-276b-4d7b-af86-7cf43e01f682" released by "delete_volume" :: held 0.692s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created reservations ['f16cae7e-550e-423e-9657-d7b78f4147ad', '604c4aba-86df-4898-9f0e-51f728d5653d', '1df552a8-34e4-49ae-8efe-11eb5becccd5', '39638a49-7d83-47f5-bbad-33f5d6a5b6fc'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:45 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:45 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-97561d00-c96a-4f58-979e-883917350a9b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-97561d00-c96a-4f58-979e-883917350a9b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:45 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Deleted volume successfully. Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ac08b936-9a58-440d-bf17-79bc07f047b7 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-efb115be-276b-4d7b-af86-7cf43e01f682-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-quobyte-97561d00-c96a-4f58-979e-883917350a9b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-97561d00-c96a-4f58-979e-883917350a9b" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61b9b9-e3fa-451b-8407-60ad0172fabd]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:46 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b Jul 29 16:19:46 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:46 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b" returned: 0 in 0.399s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:46 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b Jul 29 16:19:46 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:46 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-97561d00-c96a-4f58-979e-883917350a9b" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-97561d00-c96a-4f58-979e-883917350a9b" released by "delete_volume" :: held 0.715s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created reservations ['da64af58-7cb7-4ded-b0b1-056b0e2b2ba1', '03a6a144-df12-45f5-ab6a-236809300c93', '4c33b309-937c-4738-944d-9ece0b2aeffc', 'c0a94c13-bccf-42a1-9608-b2c80cba1dd2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:46 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:46 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:47 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.363s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-quobyte-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Deleted volume successfully. Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b96e3dbd-9792-44c6-9c32-39d63080e628 tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-97561d00-c96a-4f58-979e-883917350a9b-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[42279da0-9e73-4669-9efd-ba61b75bb207]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:47 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 Jul 29 16:19:47 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:47 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1" returned: 0 in 0.404s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:47 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1 Jul 29 16:19:47 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:47 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1" returned: 0 in 0.256s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1" released by "delete_volume" :: held 0.707s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:47 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created reservations ['6b916dd0-a7c8-40cb-8c06-4922ec0656aa', '81debef0-8474-404c-82a4-6ac8b8fbdc82', '9505863f-2854-46a2-9e7f-5aa69c7bff40', 'd9b743d2-88d9-4549-ae38-01445104220d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:48 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:48 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:48 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.302s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Deleted volume successfully. Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-0fd4bfeb-012c-472d-83a1-c8879192add8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-0fd4bfeb-012c-472d-83a1-c8879192add8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3922b71b-dc38-45d1-a39c-a489f9dd4fca tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-b1f2ff87-f9f8-4fb2-9a87-253ce9846fc1-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "cinder-quobyte-0fd4bfeb-012c-472d-83a1-c8879192add8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-0fd4bfeb-012c-472d-83a1-c8879192add8" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b258fd8f-03f2-4c86-8a3c-fc2c3f664c4a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:48 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 Jul 29 16:19:48 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:48 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8" returned: 0 in 0.433s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:48 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8 Jul 29 16:19:48 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:49 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-0fd4bfeb-012c-472d-83a1-c8879192add8" returned: 0 in 0.312s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-quobyte-0fd4bfeb-012c-472d-83a1-c8879192add8" released by "delete_volume" :: held 0.789s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Created reservations ['949ee371-f71a-47d5-8b2d-5f54cfc62f9e', 'bd2906de-6296-4333-a595-db2c3e7e732f', '017f030d-bd3c-41f5-a110-286776efafcb', '7f940958-1d87-4dde-8f03-e4a3481c49f3'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:49 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:49 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:49 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.271s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Deleted volume successfully. Jul 29 16:19:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-23f6cd89-e0af-400e-91eb-a0ea3cf5cd0d tempest-CreateVolumesFromSourceVolumeTest-1600279124 None] Lock "cinder-0fd4bfeb-012c-472d-83a1-c8879192add8-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (1992a77e-b8b0-4ef4-af6a-643678cf7da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df55f47-c981-4695-bc24-cf2e6f239630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df55f47-c981-4695-bc24-cf2e6f239630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1950377908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9046ad-6550-48fb-9800-792444263afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:53Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebeeafaf-697e-4a85-b8fd-867c8876e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebeeafaf-697e-4a85-b8fd-867c8876e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f72688-8cd4-4351-b723-a5f2cc051b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f72688-8cd4-4351-b723-a5f2cc051b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc9046ad-6550-48fb-9800-792444263afc', 'volume_name': 'volume-fc9046ad-6550-48fb-9800-792444263afc', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429c3ba5-43e3-4ca0-940c-24cc2eddab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429c3ba5-43e3-4ca0-940c-24cc2eddab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d39479c-15d7-4238-83fb-781b20c7c01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:53 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Volume fc9046ad-6550-48fb-9800-792444263afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc9046ad-6550-48fb-9800-792444263afc', 'volume_size': 1} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1950377908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9046ad-6550-48fb-9800-792444263afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:53Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Creating volume fc9046ad-6550-48fb-9800-792444263afc {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:53 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:53 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc 1073741824 Jul 29 16:19:53 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:54 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc 1073741824" returned: 0 in 0.496s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=111,cinder:UPDATE=138,cinder:DELETE=11,cinder:INSERT=44 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:54 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc Jul 29 16:19:54 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:54 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc" returned: 0 in 0.292s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d39479c-15d7-4238-83fb-781b20c7c01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9046ad-6550-48fb-9800-792444263afc', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d136706-978c-4e9a-a21e-59f75177dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Volume volume-fc9046ad-6550-48fb-9800-792444263afc (fc9046ad-6550-48fb-9800-792444263afc): created successfully Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d136706-978c-4e9a-a21e-59f75177dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (1992a77e-b8b0-4ef4-af6a-643678cf7da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f89d3943-bcd4-414a-9c81-f1f51dd65ac6 tempest-ProjectReaderTests-865517646 None] Created volume successfully. Jul 29 16:19:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-fc9046ad-6550-48fb-9800-792444263afc-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Lock "cinder-fc9046ad-6550-48fb-9800-792444263afc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-quobyte-fc9046ad-6550-48fb-9800-792444263afc" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-fc9046ad-6550-48fb-9800-792444263afc" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[70990cdf-c404-4c29-adf4-a27cc0f28ec7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:56 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc Jul 29 16:19:56 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Flow 'volume_create_manager' (372a63f8-aea5-40b7-adab-90fad64ee6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079dcf56-40d8-4b04-9941-2b240590cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079dcf56-40d8-4b04-9941-2b240590cce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-805127447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24139ce1-3113-4499-84f0-454ae294b061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdbaff56b5436a890ac75c7f9981b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:56Z,use_quota=True,user_id='99a0256f26d24fb892eb505c92fdf6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f54481-231d-45a2-9097-c9e261ee925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f54481-231d-45a2-9097-c9e261ee925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1e2cb6-4add-4b85-a1b9-9f823d285463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1e2cb6-4add-4b85-a1b9-9f823d285463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24139ce1-3113-4499-84f0-454ae294b061', 'volume_name': 'volume-24139ce1-3113-4499-84f0-454ae294b061', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87944d9-904c-46bb-8dc7-be22a147eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87944d9-904c-46bb-8dc7-be22a147eb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334b8166-3901-4c4f-9dd1-1cd1bf42c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:56 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:56 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Volume 24139ce1-3113-4499-84f0-454ae294b061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24139ce1-3113-4499-84f0-454ae294b061', 'volume_size': 1} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-805127447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24139ce1-3113-4499-84f0-454ae294b061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdbaff56b5436a890ac75c7f9981b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:56Z,use_quota=True,user_id='99a0256f26d24fb892eb505c92fdf6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Creating volume 24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:56 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc" returned: 0 in 0.436s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:56 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 1073741824 Jul 29 16:19:56 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:56 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc Jul 29 16:19:56 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:56 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fc9046ad-6550-48fb-9800-792444263afc" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-fc9046ad-6550-48fb-9800-792444263afc" released by "delete_volume" :: held 0.753s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Created reservations ['b4281a0e-2738-480a-9c79-5cbec7ee5219', '10625a06-84f1-43de-ac3a-ad47924007cf', '38c7eb77-6cfc-42f5-81fd-4425e55741a1', 'c227241c-d31d-476e-9b5f-69a8a4b6118f'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:56 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:56 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:56 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 1073741824" returned: 0 in 0.476s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:56 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:19:56 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:57 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Deleted volume successfully. Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2573e1bc-d967-4ab5-b39c-99b42ac6e4f8 tempest-ProjectReaderTests-865517646 None] Lock "cinder-fc9046ad-6550-48fb-9800-792444263afc-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:57 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.271s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334b8166-3901-4c4f-9dd1-1cd1bf42c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24139ce1-3113-4499-84f0-454ae294b061', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9459ba9-1eb1-4d1d-af2d-650e77852de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:57 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Volume volume-24139ce1-3113-4499-84f0-454ae294b061 (24139ce1-3113-4499-84f0-454ae294b061): created successfully Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9459ba9-1eb1-4d1d-af2d-650e77852de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Flow 'volume_create_manager' (372a63f8-aea5-40b7-adab-90fad64ee6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-dd33c326-15e2-4c0d-9f9d-b63567bf3dd8 tempest-VolumesDeleteCascade-1135482504 None] Created volume successfully. Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (a045609c-8915-49e6-b3e3-16ba0cd71085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec50e49d-9a05-4366-b8e6-66f409dc40d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec50e49d-9a05-4366-b8e6-66f409dc40d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058802666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d127285e-e903-4653-98c8-2e93f38db13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:57Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862ec00c-0731-4050-9575-62e24c7f9550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862ec00c-0731-4050-9575-62e24c7f9550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7dd11b-616f-4b23-a921-14ab1d84e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7dd11b-616f-4b23-a921-14ab1d84e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd127285e-e903-4653-98c8-2e93f38db13d', 'volume_name': 'volume-d127285e-e903-4653-98c8-2e93f38db13d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06077688-7791-4ac1-9dc6-9247f0bded3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06077688-7791-4ac1-9dc6-9247f0bded3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730ff2a6-9060-46c4-bd79-e8d8f61660ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:57 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Volume d127285e-e903-4653-98c8-2e93f38db13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d127285e-e903-4653-98c8-2e93f38db13d', 'volume_size': 1} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058802666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d127285e-e903-4653-98c8-2e93f38db13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:19:57Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Creating volume d127285e-e903-4653-98c8-2e93f38db13d {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:19:57 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:19:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:57 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d 1073741824 Jul 29 16:19:57 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:58 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d 1073741824" returned: 0 in 0.433s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:58 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d Jul 29 16:19:58 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:58 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730ff2a6-9060-46c4-bd79-e8d8f61660ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d127285e-e903-4653-98c8-2e93f38db13d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405f8225-2678-496b-97b9-b27fca888cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:19:58 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Volume volume-d127285e-e903-4653-98c8-2e93f38db13d (d127285e-e903-4653-98c8-2e93f38db13d): created successfully Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405f8225-2678-496b-97b9-b27fca888cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (a045609c-8915-49e6-b3e3-16ba0cd71085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:19:58 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6f58dc12-ab0b-4e59-8562-19da118ef8e8 tempest-ProjectReaderTests-865517646 None] Created volume successfully. Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-d127285e-e903-4653-98c8-2e93f38db13d-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Lock "cinder-d127285e-e903-4653-98c8-2e93f38db13d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Creating offline snapshot 421e5b90-7c9b-40b5-8cbd-523810d43816 of volume 24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-quobyte-d127285e-e903-4653-98c8-2e93f38db13d" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a78799-65ca-4b66-af05-48f9b9516cbe]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-d127285e-e903-4653-98c8-2e93f38db13d" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[441e7efe-51f9-4caf-b181-37c682bbf970]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:19:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:58 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:19:58 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:58 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d Jul 29 16:19:58 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:59 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d" returned: 0 in 0.365s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:59 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.423s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:59 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d Jul 29 16:19:59 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:59 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 1G Jul 29 16:19:59 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:59 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d127285e-e903-4653-98c8-2e93f38db13d" returned: 0 in 0.267s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-d127285e-e903-4653-98c8-2e93f38db13d" released by "delete_volume" :: held 0.677s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Created reservations ['c0cd7561-c45e-40cf-8239-fee7c5d2985d', '82ebc4d1-4e50-42a0-abbd-bfcdfc7bb182', '8609577d-a4b8-457b-979f-37f6b00b0137', 'eaefa045-da21-42ee-b070-e87a5bbbb4d9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:59 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:19:59 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:59 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 1G" returned: 0 in 0.479s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:59 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:19:59 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:19:59 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.293s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:19:59 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Deleted volume successfully. Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-941f8ea7-c3a8-4054-8672-272b5302f1c7 tempest-ProjectReaderTests-865517646 None] Lock "cinder-d127285e-e903-4653-98c8-2e93f38db13d-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:19:59 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:19:59 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 is being set with open permissions: ugo+rw Jul 29 16:19:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:19:59 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:19:59 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:00 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.274s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:00 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info Jul 29 16:20:00 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (1dcef3c7-7968-4b1f-bf86-3e4028cea5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38e51e6-7dc5-47ff-ba0b-04b08d50c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38e51e6-7dc5-47ff-ba0b-04b08d50c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1509001607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2634370-d8fe-48d3-bdc3-7d77b1ae5980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:00Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6a012a-9798-4033-bb27-5eccb4377286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6a012a-9798-4033-bb27-5eccb4377286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920d4eda-dcf8-4a10-a254-103121336c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920d4eda-dcf8-4a10-a254-103121336c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2634370-d8fe-48d3-bdc3-7d77b1ae5980', 'volume_name': 'volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be93b78-f0cc-4fda-b9d7-d5d3028489b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be93b78-f0cc-4fda-b9d7-d5d3028489b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7fdb7f-523c-41bc-be24-f80c5fac869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:00 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Volume b2634370-d8fe-48d3-bdc3-7d77b1ae5980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980', 'volume_size': 1} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:00 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info" returned: 0 in 0.257s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:00 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info is being set with open permissions: ugo+rw Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:00 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info Jul 29 16:20:00 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:00 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.info" returned: 0 in 0.281s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1509001607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2634370-d8fe-48d3-bdc3-7d77b1ae5980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:00Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Creating volume b2634370-d8fe-48d3-bdc3-7d77b1ae5980 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:00 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:00 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 1073741824 Jul 29 16:20:00 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a3f8916b-82b2-454d-b1e5-79df3453df0c tempest-VolumesDeleteCascade-1135482504 None] Create snapshot completed successfully Jul 29 16:20:01 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 1073741824" returned: 0 in 0.471s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:01 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 Jul 29 16:20:01 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:01 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7fdb7f-523c-41bc-be24-f80c5fac869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74778c8-f811-402c-a53f-ff6afb47af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Volume volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 (b2634370-d8fe-48d3-bdc3-7d77b1ae5980): created successfully Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74778c8-f811-402c-a53f-ff6afb47af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (1dcef3c7-7968-4b1f-bf86-3e4028cea5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:01 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4dc76e11-f28c-4869-bdc7-8b35529d7c51 tempest-ProjectReaderTests-865517646 None] Created volume successfully. Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Creating offline snapshot 8bc0ef59-73d1-481f-94fd-db230612739a of volume 24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b1f8c-3467-43ca-b079-3fb0744844be]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:02 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:20:02 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-b2634370-d8fe-48d3-bdc3-7d77b1ae5980-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:02 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-b2634370-d8fe-48d3-bdc3-7d77b1ae5980-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24139ce1-3113-4499-84f0-454ae294b061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:02 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a 1G Jul 29 16:20:02 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-quobyte-b2634370-d8fe-48d3-bdc3-7d77b1ae5980" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-b2634370-d8fe-48d3-bdc3-7d77b1ae5980" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d09989-4da7-4793-a1b5-14bbbcafaa90]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:02 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 Jul 29 16:20:02 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:02 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a 1G" returned: 0 in 0.484s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:02 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a Jul 29 16:20:02 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:02 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980" returned: 0 in 0.450s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:03 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980 Jul 29 16:20:03 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:03 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a" returned: 0 in 0.322s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:03 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a is being set with open permissions: ugo+rw Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:03 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b2634370-d8fe-48d3-bdc3-7d77b1ae5980" returned: 0 in 0.290s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:03 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a Jul 29 16:20:03 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-b2634370-d8fe-48d3-bdc3-7d77b1ae5980" released by "delete_volume" :: held 0.785s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Created reservations ['1f65f012-8477-4160-b65e-e7c0c45f9bee', 'f250918c-18b9-4cbc-8dac-effdb81d2f5f', '4ffb9214-8b22-4250-9b8d-764a1a249f70', '130cefd1-d856-44be-8ec2-1de7a954884a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:03 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:03 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:03 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.649s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3aecbd7a-5bef-424f-b8d6-b7a9332c35ca tempest-VolumesDeleteCascade-1135482504 None] Create snapshot completed successfully Jul 29 16:20:03 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Deleted volume successfully. Jul 29 16:20:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-78df68cd-153c-41ab-91db-4fb3cbef68cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-b2634370-d8fe-48d3-bdc3-7d77b1ae5980-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-24139ce1-3113-4499-84f0-454ae294b061-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (2aa0b3bc-da06-4770-b45f-c3439443a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97eaf97e-0a62-4678-b5b7-ee08d15c1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97eaf97e-0a62-4678-b5b7-ee08d15c1d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349040595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d5b2be-023d-4a3b-a8dc-034c009b4608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:04Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0656fc24-c242-45bd-8768-95346f240cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0656fc24-c242-45bd-8768-95346f240cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc752082-27e7-416d-9c8d-6a2e742fd8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc752082-27e7-416d-9c8d-6a2e742fd8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d5b2be-023d-4a3b-a8dc-034c009b4608', 'volume_name': 'volume-24d5b2be-023d-4a3b-a8dc-034c009b4608', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157fd5f2-5bb6-4a4b-9d88-e4d0cb02541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157fd5f2-5bb6-4a4b-9d88-e4d0cb02541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f2b1ba-c00a-403b-9dc9-2698ff026a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:04 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Volume 24d5b2be-023d-4a3b-a8dc-034c009b4608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d5b2be-023d-4a3b-a8dc-034c009b4608', 'volume_size': 1} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349040595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d5b2be-023d-4a3b-a8dc-034c009b4608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac8402d106d4196934db02199544403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:04Z,use_quota=True,user_id='4d364325b7ae446aa4e2daa3e3a422e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Creating volume 24d5b2be-023d-4a3b-a8dc-034c009b4608 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:04 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-24139ce1-3113-4499-84f0-454ae294b061-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:04 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 1073741824 Jul 29 16:20:04 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Performing cascade delete. {{(pid=88575) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-421e5b90-7c9b-40b5-8cbd-523810d43816-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-421e5b90-7c9b-40b5-8cbd-523810d43816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-421e5b90-7c9b-40b5-8cbd-523810d43816" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-421e5b90-7c9b-40b5-8cbd-523810d43816" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Deleting offline snapshot 421e5b90-7c9b-40b5-8cbd-523810d43816 of volume 24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] snapshot_file for this snap is: volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb23495e-e63d-4951-b291-174cf3d9bbd2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:04 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:20:04 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:04 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 1073741824" returned: 0 in 0.478s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:04 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 Jul 29 16:20:04 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:04 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.424s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24139ce1-3113-4499-84f0-454ae294b061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0110ba8-efee-4e62-9d3e-ea61cd7fcb58]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:04 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:20:04 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:04 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608" returned: 0 in 0.274s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f2b1ba-c00a-403b-9dc9-2698ff026a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d5b2be-023d-4a3b-a8dc-034c009b4608', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f3a551-f3c0-46cb-a338-88ce8adee1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Volume volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 (24d5b2be-023d-4a3b-a8dc-034c009b4608): created successfully Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f3a551-f3c0-46cb-a338-88ce8adee1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Flow 'volume_create_manager' (2aa0b3bc-da06-4770-b45f-c3439443a150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b6578bbe-cfcc-4bf2-9892-d4cff44beeca tempest-ProjectReaderTests-865517646 None] Created volume successfully. Jul 29 16:20:05 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.400s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067d20e-5405-4411-8d56-eb5d0cebae5a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:05 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a Jul 29 16:20:05 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:05 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24139ce1-3113-4499-84f0-454ae294b061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8e3b7-fd4e-4d14-93c4-7b54fd38dd1e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:05 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:20:05 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:05 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.374s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24139ce1-3113-4499-84f0-454ae294b061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda954a-4d82-4681-b08e-fbea40e117d4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:06 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:20:06 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-24d5b2be-023d-4a3b-a8dc-034c009b4608-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-24d5b2be-023d-4a3b-a8dc-034c009b4608-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Acquiring lock "cinder-quobyte-24d5b2be-023d-4a3b-a8dc-034c009b4608" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-24d5b2be-023d-4a3b-a8dc-034c009b4608" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b1e45-1d12-4abf-b3da-613a63b17f35]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:06 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:06 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 Jul 29 16:20:06 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:06 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:20:06 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:06 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608" returned: 0 in 0.386s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:06 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608 Jul 29 16:20:06 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:06 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:06 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816 Jul 29 16:20:06 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:06 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24d5b2be-023d-4a3b-a8dc-034c009b4608" returned: 0 in 0.264s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-quobyte-24d5b2be-023d-4a3b-a8dc-034c009b4608" released by "delete_volume" :: held 0.697s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:07 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Created reservations ['86388da3-12a6-4690-8beb-5a4e3b547f40', '039fef52-53a0-4b88-8a1d-411369fe2beb', 'c38af200-340d-4196-81b4-77887052150e', '13f0eb19-84b1-4a41-b6eb-1f39f04d502b'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.421e5b90-7c9b-40b5-8cbd-523810d43816" returned: 0 in 0.264s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a -F qcow2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:07 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a -F qcow2 Jul 29 16:20:07 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:07 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:07 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:07 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24139ce1-3113-4499-84f0-454ae294b061 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a -F qcow2" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:07 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-421e5b90-7c9b-40b5-8cbd-523810d43816" released by "_delete_snapshot" :: held 3.101s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Deleted volume successfully. Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" released by "delete_snapshot" :: held 3.131s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a77d9252-1a7e-4fb6-b102-3bd09992a7cc tempest-ProjectReaderTests-865517646 None] Lock "cinder-24d5b2be-023d-4a3b-a8dc-034c009b4608-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Created reservations ['bf7ca2a3-9a6e-4893-aa75-b4dd10c2ae71', 'aae1931a-b990-41da-bf21-5cc6a0f5fcd5', '199b38de-eb19-4d2e-8394-085c2ae35a9b', '766aeacb-06d1-4f05-a075-a09f12004760'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Delete snapshot completed successfully. Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-421e5b90-7c9b-40b5-8cbd-523810d43816-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-8bc0ef59-73d1-481f-94fd-db230612739a-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-8bc0ef59-73d1-481f-94fd-db230612739a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-8bc0ef59-73d1-481f-94fd-db230612739a" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-8bc0ef59-73d1-481f-94fd-db230612739a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Deleting offline snapshot 8bc0ef59-73d1-481f-94fd-db230612739a of volume 24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] snapshot_file for this snap is: volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efa20d-e84d-4b16-8f11-7e5acbe6a382]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:07 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a Jul 29 16:20:07 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:08 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a" returned: 0 in 0.365s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24139ce1-3113-4499-84f0-454ae294b061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bec079-4db5-4a80-9576-e9398f83c9f7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:08 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:20:08 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:08 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.422s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:08 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a Jul 29 16:20:08 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:08 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:08 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a Jul 29 16:20:08 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:09 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061.8bc0ef59-73d1-481f-94fd-db230612739a" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-8bc0ef59-73d1-481f-94fd-db230612739a" released by "_delete_snapshot" :: held 1.538s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" released by "delete_snapshot" :: held 1.559s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Created reservations ['dba25745-a875-4eb5-b14f-b51a88864059', 'ab166b8b-5d9b-48dd-8861-b111f2dfa7ff', '546d749f-13ae-4a02-960d-e23c72f55028', 'a9cf6b83-63d9-4f81-b90f-01e447dbd7f6'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Delete snapshot completed successfully. Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-8bc0ef59-73d1-481f-94fd-db230612739a-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Snapshots deleted, issuing volume delete {{(pid=88575) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" acquired by "delete_volume" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[df727660-67be-4eaa-a58b-d9e549c9e2ba]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:09 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:20:09 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:09 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.363s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:09 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061 Jul 29 16:20:09 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:09 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24139ce1-3113-4499-84f0-454ae294b061" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-24139ce1-3113-4499-84f0-454ae294b061" released by "delete_volume" :: held 0.677s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Created reservations ['14d7226e-6582-4d98-bf6d-05f688a7a1e3', 'cdb2931e-27e5-4fdd-95b9-52825612eaf6', '90a2ba8e-e0dc-44ca-b12a-cc43d6b648b2', 'fa3324a1-0535-40d8-9a21-5dad9104bd96'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:10 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:10 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:10 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.243s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:10 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Deleted volume successfully. Jul 29 16:20:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0acce087-d493-4a2a-8320-9aa3974ba4b7 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-24139ce1-3113-4499-84f0-454ae294b061-delete_volume" released by "delete_volume" :: held 6.223s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Flow 'volume_create_manager' (515192bd-ecaf-45c5-b225-e47f94b8ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd89569-3c80-4e1e-9bc0-817ace44c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd89569-3c80-4e1e-9bc0-817ace44c887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1955383023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869641be-e3aa-4f6b-bec2-ad05762c48f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdbaff56b5436a890ac75c7f9981b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:11Z,use_quota=True,user_id='99a0256f26d24fb892eb505c92fdf6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13851646-6c3e-4f4e-984a-1b48892ff2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13851646-6c3e-4f4e-984a-1b48892ff2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf5ebe2-466d-44b1-9c02-799ec1509a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf5ebe2-466d-44b1-9c02-799ec1509a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869641be-e3aa-4f6b-bec2-ad05762c48f8', 'volume_name': 'volume-869641be-e3aa-4f6b-bec2-ad05762c48f8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc63e3d-8a82-4c77-8c44-6d0577dffe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc63e3d-8a82-4c77-8c44-6d0577dffe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea784819-ec68-4263-a4ec-4c5283fa032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Volume 869641be-e3aa-4f6b-bec2-ad05762c48f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869641be-e3aa-4f6b-bec2-ad05762c48f8', 'volume_size': 1} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1955383023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869641be-e3aa-4f6b-bec2-ad05762c48f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdbaff56b5436a890ac75c7f9981b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:11Z,use_quota=True,user_id='99a0256f26d24fb892eb505c92fdf6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Creating volume 869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:11 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:11 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 1073741824 Jul 29 16:20:11 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:11 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 1073741824" returned: 0 in 0.418s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:11 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:11 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:11 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.243s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea784819-ec68-4263-a4ec-4c5283fa032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869641be-e3aa-4f6b-bec2-ad05762c48f8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cc89d3-2399-407c-8571-e5175b32da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Volume volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 (869641be-e3aa-4f6b-bec2-ad05762c48f8): created successfully Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cc89d3-2399-407c-8571-e5175b32da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Flow 'volume_create_manager' (515192bd-ecaf-45c5-b225-e47f94b8ec54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-896116d3-5e49-45e6-a8c8-12162d5c72e5 tempest-VolumesDeleteCascade-1135482504 None] Created volume successfully. Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Creating offline snapshot 8820a9c9-4737-40ea-9073-31b775365698 of volume 869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684e97e-c5a3-4efa-a64a-f4bad3edf536]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:12 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:12 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:12 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.360s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:12 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 1G Jul 29 16:20:12 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:13 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 1G" returned: 0 in 0.395s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:13 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 Jul 29 16:20:13 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:13 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:13 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 is being set with open permissions: ugo+rw Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:13 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 Jul 29 16:20:13 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:13 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698" returned: 0 in 0.235s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:13 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info Jul 29 16:20:13 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:13 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:13 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info is being set with open permissions: ugo+rw Jul 29 16:20:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:13 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info Jul 29 16:20:13 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:14 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.info" returned: 0 in 0.251s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4a8b7500-cdd6-4a67-85ee-c0d9a9d520df tempest-VolumesDeleteCascade-1135482504 None] Create snapshot completed successfully Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Flow 'volume_create_manager' (d9eafd3e-a4f9-401c-bf8b-32a4d8bbb836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31e3c7a-e739-4b32-9757-43c0fe76f6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31e3c7a-e739-4b32-9757-43c0fe76f6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-548762688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c603337f-da25-442a-86a8-890c88cf74dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fdbaff56b5436a890ac75c7f9981b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8820a9c9-4737-40ea-9073-31b775365698,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:15Z,use_quota=True,user_id='99a0256f26d24fb892eb505c92fdf6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095a099f-bbd0-4217-b4de-e29829b0bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095a099f-bbd0-4217-b4de-e29829b0bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f31cf12-b863-4874-8e86-1e79af786a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f31cf12-b863-4874-8e86-1e79af786a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c603337f-da25-442a-86a8-890c88cf74dd', 'volume_name': 'volume-c603337f-da25-442a-86a8-890c88cf74dd', 'volume_size': 1, 'snapshot_id': '8820a9c9-4737-40ea-9073-31b775365698'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5636b218-f6c6-46f7-b55e-1f6e4e8eddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5636b218-f6c6-46f7-b55e-1f6e4e8eddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c30c8c-0d2a-4a7e-aeea-fc0c4052e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Volume c603337f-da25-442a-86a8-890c88cf74dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c603337f-da25-442a-86a8-890c88cf74dd', 'volume_size': 1, 'snapshot_id': '8820a9c9-4737-40ea-9073-31b775365698'} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-8820a9c9-4737-40ea-9073-31b775365698-c603337f-da25-442a-86a8-890c88cf74dd" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-8820a9c9-4737-40ea-9073-31b775365698-c603337f-da25-442a-86a8-890c88cf74dd" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Creating volume c603337f-da25-442a-86a8-890c88cf74dd from snapshot 8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-c603337f-da25-442a-86a8-890c88cf74dd" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-c603337f-da25-442a-86a8-890c88cf74dd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] snapshot: 8820a9c9-4737-40ea-9073-31b775365698, volume: c603337f-da25-442a-86a8-890c88cf74dd, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab81ce2-5198-4a68-856a-72d1cf8ded6e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:15 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 Jul 29 16:20:15 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:15 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869641be-e3aa-4f6b-bec2-ad05762c48f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[835ff826-2fb0-47da-a694-f31473a2c87e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:15 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:15 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:15 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:20:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:15 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd Jul 29 16:20:15 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:19 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd" returned: 0 in 4.195s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae8cdff-a506-4ae6-9d18-d4bcefe33237]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:20 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:20 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:20 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.594s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:20:20 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Converted 1024.00 MB image at 244.02 MB/s Jul 29 16:20:20 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd is being set with open permissions: ugo+rw Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:20 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd Jul 29 16:20:20 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:20 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd" returned: 0 in 0.270s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-c603337f-da25-442a-86a8-890c88cf74dd" released by "_copy_volume_from_snapshot" :: held 5.853s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-8820a9c9-4737-40ea-9073-31b775365698-c603337f-da25-442a-86a8-890c88cf74dd" released by "_create_volume_from_snapshot" :: held 5.886s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.903s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c30c8c-0d2a-4a7e-aeea-fc0c4052e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c603337f-da25-442a-86a8-890c88cf74dd', 'volume_size': 1, 'snapshot_id': '8820a9c9-4737-40ea-9073-31b775365698'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed31860-a5a6-4222-be15-2a342d55a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:20 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Volume volume-c603337f-da25-442a-86a8-890c88cf74dd (c603337f-da25-442a-86a8-890c88cf74dd): created successfully Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed31860-a5a6-4222-be15-2a342d55a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Flow 'volume_create_manager' (d9eafd3e-a4f9-401c-bf8b-32a4d8bbb836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d90feb79-5b26-4af7-a6ce-7adfae8a5cfe tempest-VolumesDeleteCascade-1135482504 None] Created volume successfully. Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-869641be-e3aa-4f6b-bec2-ad05762c48f8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-869641be-e3aa-4f6b-bec2-ad05762c48f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Performing cascade delete. {{(pid=88575) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-8820a9c9-4737-40ea-9073-31b775365698-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-8820a9c9-4737-40ea-9073-31b775365698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-869641be-e3aa-4f6b-bec2-ad05762c48f8" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-869641be-e3aa-4f6b-bec2-ad05762c48f8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-8820a9c9-4737-40ea-9073-31b775365698" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-8820a9c9-4737-40ea-9073-31b775365698" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Deleting offline snapshot 8820a9c9-4737-40ea-9073-31b775365698 of volume 869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] snapshot_file for this snap is: volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c860e-d501-40c9-b61c-0462f17eb646]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:21 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 Jul 29 16:20:21 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:22 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869641be-e3aa-4f6b-bec2-ad05762c48f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ea8428-c7d6-407f-b5d3-7d7c30e08f3b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:22 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:22 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:22 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.384s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:22 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 Jul 29 16:20:22 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:22 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:22 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698 Jul 29 16:20:22 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:23 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8.8820a9c9-4737-40ea-9073-31b775365698" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-8820a9c9-4737-40ea-9073-31b775365698" released by "_delete_snapshot" :: held 1.435s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-869641be-e3aa-4f6b-bec2-ad05762c48f8" released by "delete_snapshot" :: held 1.457s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Created reservations ['133d2487-d583-4f0a-a695-d7d9d4825e7b', '4ec7d416-b9e4-4981-9a32-af89878909fe', 'f54a6bfe-27ab-40bb-b6ca-ae108f460f5b', '034a728e-9ad9-4735-888a-b03295f002c5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Delete snapshot completed successfully. Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-8820a9c9-4737-40ea-9073-31b775365698-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Snapshots deleted, issuing volume delete {{(pid=88575) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-869641be-e3aa-4f6b-bec2-ad05762c48f8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-869641be-e3aa-4f6b-bec2-ad05762c48f8" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304f079-97c9-4eb4-b401-7003cdd4947f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:23 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:23 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:23 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.408s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:23 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8 Jul 29 16:20:23 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:23 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-869641be-e3aa-4f6b-bec2-ad05762c48f8" returned: 0 in 0.284s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-869641be-e3aa-4f6b-bec2-ad05762c48f8" released by "delete_volume" :: held 0.757s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Created reservations ['1458677b-0dd9-4502-9518-b4323907c214', '91e6f3a2-4d7a-431f-8d00-0d0e28ee1e31', '7c2d302d-1304-4370-86c6-e10a7466b819', '11571451-d1f9-465b-8eef-85fb2c0287e5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:24 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:24 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:24 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Deleted volume successfully. Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7a2b8ac1-83a1-47a5-af8a-3fb2ceaa79e2 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-869641be-e3aa-4f6b-bec2-ad05762c48f8-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-c603337f-da25-442a-86a8-890c88cf74dd-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-c603337f-da25-442a-86a8-890c88cf74dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "cinder-quobyte-c603337f-da25-442a-86a8-890c88cf74dd" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-c603337f-da25-442a-86a8-890c88cf74dd" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[032ede99-a7b4-4113-ba5e-5d435e232d6b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:25 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd Jul 29 16:20:25 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:25 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd" returned: 0 in 0.375s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:25 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd Jul 29 16:20:25 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:25 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c603337f-da25-442a-86a8-890c88cf74dd" returned: 0 in 0.265s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-quobyte-c603337f-da25-442a-86a8-890c88cf74dd" released by "delete_volume" :: held 0.684s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Created reservations ['10f4a892-f7af-401d-997a-1e94f18946ae', '1bd8b5ed-b669-45c4-b101-3f9928c7983d', '1085f020-8d22-4000-8de8-d43e5763cd2e', '5b388e76-8a57-47eb-96f0-4247af031c66'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:25 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:25 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:26 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:26 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Deleted volume successfully. Jul 29 16:20:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b14dc2b-ed54-44c7-abb7-b9f631e63bf4 tempest-VolumesDeleteCascade-1135482504 None] Lock "cinder-c603337f-da25-442a-86a8-890c88cf74dd-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Flow 'volume_create_manager' (6550b28a-1027-46cc-88f2-b0feb430d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09df9f36-d748-4801-89d7-0e5d0770e320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09df9f36-d748-4801-89d7-0e5d0770e320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1678478607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775acf72-aa5c-4f56-b77c-7f055e8dafd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe6aee8a9e14b1797c9aafc5ec47984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:29Z,use_quota=True,user_id='c97c3149c26c48848b957e9fd9c9270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3716c625-bf5f-4731-8637-82be5fd8cff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3716c625-bf5f-4731-8637-82be5fd8cff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef876151-79e3-4838-86c0-e052517c5af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef876151-79e3-4838-86c0-e052517c5af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775acf72-aa5c-4f56-b77c-7f055e8dafd2', 'volume_name': 'volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98faedb1-3b60-4b39-bacb-7db10a256a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98faedb1-3b60-4b39-bacb-7db10a256a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd660d1-9cb7-414e-b2b5-c8bf55449c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:28 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Volume 775acf72-aa5c-4f56-b77c-7f055e8dafd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2', 'volume_size': 1} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1678478607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775acf72-aa5c-4f56-b77c-7f055e8dafd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe6aee8a9e14b1797c9aafc5ec47984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:29Z,use_quota=True,user_id='c97c3149c26c48848b957e9fd9c9270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Creating volume 775acf72-aa5c-4f56-b77c-7f055e8dafd2 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:28 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:28 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 1073741824 Jul 29 16:20:28 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:29 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 1073741824" returned: 0 in 0.419s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:29 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 Jul 29 16:20:29 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:29 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2" returned: 0 in 0.271s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd660d1-9cb7-414e-b2b5-c8bf55449c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e826bbd-7baa-4507-8737-b8d1fcedc635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:29 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Volume volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 (775acf72-aa5c-4f56-b77c-7f055e8dafd2): created successfully Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e826bbd-7baa-4507-8737-b8d1fcedc635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:29 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Flow 'volume_create_manager' (6550b28a-1027-46cc-88f2-b0feb430d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8cae38a8-bb5e-4074-828c-2688b2b19809 tempest-VolumesMetadataTest-1023068024 None] Created volume successfully. Jul 29 16:20:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Acquiring lock "cinder-775acf72-aa5c-4f56-b77c-7f055e8dafd2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Lock "cinder-775acf72-aa5c-4f56-b77c-7f055e8dafd2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Acquiring lock "cinder-quobyte-775acf72-aa5c-4f56-b77c-7f055e8dafd2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Lock "cinder-quobyte-775acf72-aa5c-4f56-b77c-7f055e8dafd2" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:30 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283fafe-3e05-4118-b8e9-7b31de11fe06]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:30 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 Jul 29 16:20:30 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:31 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2" returned: 0 in 0.374s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:31 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2 Jul 29 16:20:31 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:31 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-775acf72-aa5c-4f56-b77c-7f055e8dafd2" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Lock "cinder-quobyte-775acf72-aa5c-4f56-b77c-7f055e8dafd2" released by "delete_volume" :: held 0.663s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Created reservations ['1ce23284-76c2-45ac-9c57-6ff29a979ffd', '24138745-7eed-4e6b-98d5-fca91f002de2', '85d260d1-7cbb-4eec-826e-36a57f9357b5', '3fedb4f3-4fcd-437b-bc66-4de66202bc10'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:31 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:31 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:31 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.237s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Deleted volume successfully. Jul 29 16:20:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-80967488-3200-4d48-affc-6987320c2332 tempest-VolumesMetadataTest-1023068024 None] Lock "cinder-775acf72-aa5c-4f56-b77c-7f055e8dafd2-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Flow 'volume_create_manager' (509417cd-6b68-49fb-8573-0653c579c861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1975ec-c3ac-46cf-904e-e9764c47a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=139,cinder:UPDATE=187,cinder:DELETE=15,cinder:INSERT=42 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1975ec-c3ac-46cf-904e-e9764c47a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2023854796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9badb742-4f03-4de2-9189-c76fb823ab4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af56f6f299441ab4a5091d9262ff66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:36Z,use_quota=True,user_id='0773e5a4c8504b67a94d0ed885ce410b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4433b31d-9ef5-4ced-b6cb-6e89fb0abb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4433b31d-9ef5-4ced-b6cb-6e89fb0abb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1724dc-9338-440b-b7c8-23a9284eb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1724dc-9338-440b-b7c8-23a9284eb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9badb742-4f03-4de2-9189-c76fb823ab4a', 'volume_name': 'volume-9badb742-4f03-4de2-9189-c76fb823ab4a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e611952b-94a0-43a3-a0b3-998dc0446494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e611952b-94a0-43a3-a0b3-998dc0446494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32460b8b-9382-4ab7-a7bf-96c2a5563de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:35 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Volume 9badb742-4f03-4de2-9189-c76fb823ab4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9badb742-4f03-4de2-9189-c76fb823ab4a', 'volume_size': 1} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2023854796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9badb742-4f03-4de2-9189-c76fb823ab4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af56f6f299441ab4a5091d9262ff66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:36Z,use_quota=True,user_id='0773e5a4c8504b67a94d0ed885ce410b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Creating volume 9badb742-4f03-4de2-9189-c76fb823ab4a {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:35 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:35 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a 1073741824 Jul 29 16:20:35 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:36 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a 1073741824" returned: 0 in 0.468s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:36 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a Jul 29 16:20:36 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:36 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a" returned: 0 in 0.256s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32460b8b-9382-4ab7-a7bf-96c2a5563de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9badb742-4f03-4de2-9189-c76fb823ab4a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:36 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:36 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ff330b-a0ed-402d-befa-05626e7ded61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:36 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Volume volume-9badb742-4f03-4de2-9189-c76fb823ab4a (9badb742-4f03-4de2-9189-c76fb823ab4a): created successfully Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ff330b-a0ed-402d-befa-05626e7ded61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Flow 'volume_create_manager' (509417cd-6b68-49fb-8573-0653c579c861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e2d311d2-39a8-4049-a188-c1c21374b995 tempest-VolumesTransfersV355Test-1469241915 None] Created volume successfully. Jul 29 16:20:37 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.263s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ec504e78-acfa-4673-acdb-5dc4ba473e28 tempest-VolumesTransfersV355Test-764712501 None] Transfer volume completed successfully. Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Acquiring lock "cinder-9badb742-4f03-4de2-9189-c76fb823ab4a-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-9badb742-4f03-4de2-9189-c76fb823ab4a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Acquiring lock "cinder-quobyte-9badb742-4f03-4de2-9189-c76fb823ab4a" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-quobyte-9badb742-4f03-4de2-9189-c76fb823ab4a" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[736cb2a8-e411-4785-970b-f3e92660644d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:39 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a Jul 29 16:20:39 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:39 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a" returned: 0 in 0.384s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:39 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a Jul 29 16:20:39 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:39 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9badb742-4f03-4de2-9189-c76fb823ab4a" returned: 0 in 0.270s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-quobyte-9badb742-4f03-4de2-9189-c76fb823ab4a" released by "delete_volume" :: held 0.692s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Created reservations ['07d67123-b387-4693-9aea-2f790954712d', 'ba7c7b1c-e684-4a99-921e-9f2f89b5670f', 'f89d8839-1ebd-4a7d-ba71-306f08a2e4ec', '82f653bf-cfd8-4bd7-a528-044bda0a911c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:39 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:39 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:40 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Deleted volume successfully. Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-250057fb-0f05-4402-88d9-48f34600f30a tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-9badb742-4f03-4de2-9189-c76fb823ab4a-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Flow 'volume_create_manager' (8b40cf7c-d44b-4b5f-a637-dcb462f29bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ba1014-8703-46ab-bd4d-cdc10b47ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ba1014-8703-46ab-bd4d-cdc10b47ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1631961613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb50bd3-43e1-4a32-b5a9-d33e79648adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af56f6f299441ab4a5091d9262ff66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:41Z,use_quota=True,user_id='0773e5a4c8504b67a94d0ed885ce410b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2c1129-2c08-437b-959b-693a83fdac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2c1129-2c08-437b-959b-693a83fdac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb70639-955b-4a54-b59e-ad9577fbb1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb70639-955b-4a54-b59e-ad9577fbb1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb50bd3-43e1-4a32-b5a9-d33e79648adc', 'volume_name': 'volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6152bee1-4533-4150-8309-b0f7dcf75499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6152bee1-4533-4150-8309-b0f7dcf75499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7a166a-4dc7-40bd-9f6f-d320b6bcd916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Volume ecb50bd3-43e1-4a32-b5a9-d33e79648adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc', 'volume_size': 1} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1631961613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb50bd3-43e1-4a32-b5a9-d33e79648adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af56f6f299441ab4a5091d9262ff66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:41Z,use_quota=True,user_id='0773e5a4c8504b67a94d0ed885ce410b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Creating volume ecb50bd3-43e1-4a32-b5a9-d33e79648adc {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:40 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:40 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc 1073741824 Jul 29 16:20:40 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:41 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc 1073741824" returned: 0 in 0.446s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:41 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc Jul 29 16:20:41 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:41 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc" returned: 0 in 0.256s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7a166a-4dc7-40bd-9f6f-d320b6bcd916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3504182-e639-476d-aaca-5fe441707933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Volume volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc (ecb50bd3-43e1-4a32-b5a9-d33e79648adc): created successfully Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3504182-e639-476d-aaca-5fe441707933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Flow 'volume_create_manager' (8b40cf7c-d44b-4b5f-a637-dcb462f29bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2e7410b6-90f5-4ba5-8363-92fb60ded9d7 tempest-VolumesTransfersV355Test-1469241915 None] Created volume successfully. Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Acquiring lock "cinder-ecb50bd3-43e1-4a32-b5a9-d33e79648adc-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-ecb50bd3-43e1-4a32-b5a9-d33e79648adc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Acquiring lock "cinder-quobyte-ecb50bd3-43e1-4a32-b5a9-d33e79648adc" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-quobyte-ecb50bd3-43e1-4a32-b5a9-d33e79648adc" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3e3fd-93f5-4a75-90e3-936e090c4435]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:43 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc Jul 29 16:20:43 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:43 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc" returned: 0 in 0.375s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:43 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc Jul 29 16:20:43 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:43 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ecb50bd3-43e1-4a32-b5a9-d33e79648adc" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-quobyte-ecb50bd3-43e1-4a32-b5a9-d33e79648adc" released by "delete_volume" :: held 0.662s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Created reservations ['ae0594b3-352e-45fc-8397-9b418a898eb6', 'ce6241a4-3a20-4a6d-9802-b3812b7e5452', '2de167f7-e4c2-40fe-9a66-5d8c4b1213f4', '59ee5693-f6c1-44f2-b65a-2559eaf12406'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:43 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:43 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:44 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Deleted volume successfully. Jul 29 16:20:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5b3ae36f-082e-416a-b77d-c30e2a15cf3e tempest-VolumesTransfersV355Test-1027245577 None] Lock "cinder-ecb50bd3-43e1-4a32-b5a9-d33e79648adc-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Flow 'volume_create_manager' (b6643724-5770-482d-af7c-9aee7c70f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3668a90-a460-4f2c-97a7-adbf38c34d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3668a90-a460-4f2c-97a7-adbf38c34d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1686413046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2b6901-26fe-4f5c-92e7-7fb93afdf470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a307962eb8d04ac184e925276f8343be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:51Z,use_quota=True,user_id='61ba34efa2c640b4b027c81c580d13f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c132249f-dd0b-4bf8-ab2c-b29f25ce72df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c132249f-dd0b-4bf8-ab2c-b29f25ce72df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bb616a-3609-4d70-bf06-1fd86d3deeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bb616a-3609-4d70-bf06-1fd86d3deeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2b6901-26fe-4f5c-92e7-7fb93afdf470', 'volume_name': 'volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427427b4-3852-4e78-a872-2a9a27164180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427427b4-3852-4e78-a872-2a9a27164180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47de9f44-26df-47e9-9a75-78324d74ae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:51 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Volume bc2b6901-26fe-4f5c-92e7-7fb93afdf470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470', 'volume_size': 1} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1686413046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2b6901-26fe-4f5c-92e7-7fb93afdf470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a307962eb8d04ac184e925276f8343be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:51Z,use_quota=True,user_id='61ba34efa2c640b4b027c81c580d13f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Creating volume bc2b6901-26fe-4f5c-92e7-7fb93afdf470 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:51 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:51 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 1073741824 Jul 29 16:20:51 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:51 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 1073741824" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:52 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 Jul 29 16:20:52 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:52 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47de9f44-26df-47e9-9a75-78324d74ae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e54259a-97d0-4396-b6da-8888a0c73c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:52 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Volume volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 (bc2b6901-26fe-4f5c-92e7-7fb93afdf470): created successfully Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e54259a-97d0-4396-b6da-8888a0c73c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Flow 'volume_create_manager' (b6643724-5770-482d-af7c-9aee7c70f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7f3f4197-be7e-4c99-aea4-471460a29ba9 tempest-VolumesTransfersV357Test-2060524184 None] Created volume successfully. Jul 29 16:20:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0cc1d07e-7f01-4e14-aa59-10e98f1355d4 tempest-VolumesTransfersV357Test-2038783962 None] Transfer volume completed successfully. Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Acquiring lock "cinder-bc2b6901-26fe-4f5c-92e7-7fb93afdf470-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-bc2b6901-26fe-4f5c-92e7-7fb93afdf470-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Acquiring lock "cinder-quobyte-bc2b6901-26fe-4f5c-92e7-7fb93afdf470" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-quobyte-bc2b6901-26fe-4f5c-92e7-7fb93afdf470" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c8621-d879-42b8-8002-15da8d455dfa]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:53 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 Jul 29 16:20:53 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:53 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:54 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470 Jul 29 16:20:54 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:54 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bc2b6901-26fe-4f5c-92e7-7fb93afdf470" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-quobyte-bc2b6901-26fe-4f5c-92e7-7fb93afdf470" released by "delete_volume" :: held 0.674s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=142,cinder:DELETE=15,cinder:SELECT=93,cinder:INSERT=32 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Created reservations ['65edbe47-7fc7-4a65-a985-260c97c5fc03', '653ca2d9-c17e-404b-be3a-fe5adfdefb24', '03db28fe-8e7e-435b-a011-dfe4598757a3', '4bd73d07-bc7e-4ace-bc9f-7fd83984712a'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:54 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:54 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:54 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Deleted volume successfully. Jul 29 16:20:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-66ae8867-f079-4ceb-b6cb-65f345dd7c89 tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-bc2b6901-26fe-4f5c-92e7-7fb93afdf470-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Flow 'volume_create_manager' (e0f5f78e-03b3-4969-b37f-81aacca1d73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5005cfd-5c68-4605-9a1b-f7bdab052b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5005cfd-5c68-4605-9a1b-f7bdab052b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1886974470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0166eb3-13b7-4250-85f3-f4450ea6acc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a307962eb8d04ac184e925276f8343be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:55Z,use_quota=True,user_id='61ba34efa2c640b4b027c81c580d13f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0f9b84-dfe1-4ad9-aeb0-6081991c00c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0f9b84-dfe1-4ad9-aeb0-6081991c00c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e823289-a726-4e3d-a494-8da6c7093e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e823289-a726-4e3d-a494-8da6c7093e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0166eb3-13b7-4250-85f3-f4450ea6acc9', 'volume_name': 'volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba148b2-fd3b-43c4-b256-2f7b38e1f4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba148b2-fd3b-43c4-b256-2f7b38e1f4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c6de11-77fb-424e-914a-3a451943dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:55 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Volume f0166eb3-13b7-4250-85f3-f4450ea6acc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9', 'volume_size': 1} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1886974470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0166eb3-13b7-4250-85f3-f4450ea6acc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a307962eb8d04ac184e925276f8343be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:20:55Z,use_quota=True,user_id='61ba34efa2c640b4b027c81c580d13f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Creating volume f0166eb3-13b7-4250-85f3-f4450ea6acc9 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:20:55 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:55 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 1073741824 Jul 29 16:20:55 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:55 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 1073741824" returned: 0 in 0.454s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:55 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 Jul 29 16:20:55 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:56 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9" returned: 0 in 0.238s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c6de11-77fb-424e-914a-3a451943dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f62b4fd-6089-4d4e-b645-a77e7dca96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:20:56 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Volume volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 (f0166eb3-13b7-4250-85f3-f4450ea6acc9): created successfully Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f62b4fd-6089-4d4e-b645-a77e7dca96cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Flow 'volume_create_manager' (e0f5f78e-03b3-4969-b37f-81aacca1d73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:20:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ce6fd8af-fb0a-4ac9-827c-b0724814ac09 tempest-VolumesTransfersV357Test-2060524184 None] Created volume successfully. Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Acquiring lock "cinder-f0166eb3-13b7-4250-85f3-f4450ea6acc9-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-f0166eb3-13b7-4250-85f3-f4450ea6acc9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Acquiring lock "cinder-quobyte-f0166eb3-13b7-4250-85f3-f4450ea6acc9" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-quobyte-f0166eb3-13b7-4250-85f3-f4450ea6acc9" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5719fde-926d-4761-99ea-9e947085c37b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:56 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 Jul 29 16:20:56 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:56 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9" returned: 0 in 0.363s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:56 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9 Jul 29 16:20:56 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:57 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f0166eb3-13b7-4250-85f3-f4450ea6acc9" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-quobyte-f0166eb3-13b7-4250-85f3-f4450ea6acc9" released by "delete_volume" :: held 0.675s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Created reservations ['9a67a63c-3412-4845-b4ec-c267d8e406eb', 'bf0d1d7a-a683-4510-a7b1-c972d4c7f465', 'f61233b6-56ea-4285-89da-95fddfb11215', '4a82be60-17e7-4c14-9639-fa2a446971e5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:20:57 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:20:57 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:20:57 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:20:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Deleted volume successfully. Jul 29 16:20:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ea7caa6a-65e1-4aab-a700-0c9421d025bd tempest-VolumesTransfersV357Test-32021479 None] Lock "cinder-f0166eb3-13b7-4250-85f3-f4450ea6acc9-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:02 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (32891c6a-e8db-478d-8801-60707858462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bde4f9c-1ed3-4758-9c1c-1936756cc4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bde4f9c-1ed3-4758-9c1c-1936756cc4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-829653141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f121e1e1-ca66-4875-ba78-1c7d8ab82ebe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:03Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45991670-1d26-4998-a417-66557aca422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45991670-1d26-4998-a417-66557aca422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf5e940-c6d8-4996-b721-d37c57bce140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf5e940-c6d8-4996-b721-d37c57bce140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f121e1e1-ca66-4875-ba78-1c7d8ab82ebe', 'volume_name': 'volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e18859-9652-4202-a828-adf14fd4d3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e18859-9652-4202-a828-adf14fd4d3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8382e5-dfe1-45ff-98a8-7741b2725da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Volume f121e1e1-ca66-4875-ba78-1c7d8ab82ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe', 'volume_size': 1} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-829653141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f121e1e1-ca66-4875-ba78-1c7d8ab82ebe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:03Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Creating volume f121e1e1-ca66-4875-ba78-1c7d8ab82ebe {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:03 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:03 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe 1073741824 Jul 29 16:21:03 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:03 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe 1073741824" returned: 0 in 0.449s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:03 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe Jul 29 16:21:03 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:03 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe" returned: 0 in 0.251s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8382e5-dfe1-45ff-98a8-7741b2725da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faf24a6-3239-4307-a721-984d6a4d1817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Volume volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe (f121e1e1-ca66-4875-ba78-1c7d8ab82ebe): created successfully Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faf24a6-3239-4307-a721-984d6a4d1817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (32891c6a-e8db-478d-8801-60707858462c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9f54e326-f66d-40ef-a889-bc84e612814d tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (2e3c6fcb-3e6c-4946-8d74-5dbc6b2cfbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3489d76-2085-4ca7-8723-8800e3238661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3489d76-2085-4ca7-8723-8800e3238661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1317090798',display_name='tempest-VolumesGetTest-Volume-2065611631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c93a1cd-69f0-49b9-bcd6-5d17366eb78c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:05Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f24026-2d8a-458a-8803-68182da617d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f24026-2d8a-458a-8803-68182da617d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d651e1b-730f-4dd6-9e5d-3ac5d5e517d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d651e1b-730f-4dd6-9e5d-3ac5d5e517d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c93a1cd-69f0-49b9-bcd6-5d17366eb78c', 'volume_name': 'volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158f5f14-cc29-43fa-8296-9adc81303c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158f5f14-cc29-43fa-8296-9adc81303c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69eb2c7f-b7d6-4734-a2d4-e464b3b87988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:04 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Volume 6c93a1cd-69f0-49b9-bcd6-5d17366eb78c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c', 'volume_size': 1} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1317090798',display_name='tempest-VolumesGetTest-Volume-2065611631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c93a1cd-69f0-49b9-bcd6-5d17366eb78c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:05Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Creating volume 6c93a1cd-69f0-49b9-bcd6-5d17366eb78c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:04 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:04 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c 1073741824 Jul 29 16:21:04 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:05 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c 1073741824" returned: 0 in 0.451s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:05 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c Jul 29 16:21:05 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:05 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69eb2c7f-b7d6-4734-a2d4-e464b3b87988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e9f4fd-ea78-4c38-ade1-4189de58d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Volume volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c (6c93a1cd-69f0-49b9-bcd6-5d17366eb78c): created successfully Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e9f4fd-ea78-4c38-ade1-4189de58d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (2e3c6fcb-3e6c-4946-8d74-5dbc6b2cfbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-808f2bc1-66ef-4d0e-83f7-d529e0aeded2 tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Lock "cinder-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ddba3a-80cb-459b-bd6d-ab075f1ac3e6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:06 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c Jul 29 16:21:06 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:06 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c" returned: 0 in 0.366s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:06 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c Jul 29 16:21:06 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:06 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c" released by "delete_volume" :: held 0.669s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Created reservations ['6019b80e-0154-4a2d-9889-2094a7e744f7', '9e2190c4-6fad-401c-b097-8b95653fe4da', '04314337-f60d-4425-8886-2e9781b13c80', 'b58e4d0e-a31f-4016-b868-e24ae555f21d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:06 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:06 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:06 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.235s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:06 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-68e9601a-914a-4d0c-99f3-bb40c5e49d0f tempest-VolumesGetTest-567869944 None] Lock "cinder-6c93a1cd-69f0-49b9-bcd6-5d17366eb78c-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Lock "cinder-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcebf90-65e6-48fb-abd4-867587e826e5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:07 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe Jul 29 16:21:07 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:07 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe" returned: 0 in 0.364s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:07 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe Jul 29 16:21:07 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:07 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe" returned: 0 in 0.251s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe" released by "delete_volume" :: held 0.653s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Created reservations ['8973d18f-ad89-4f9e-b534-9d6a2d0f6474', '56b2b7ca-d2a9-44b4-bee4-09bd3c8f946f', 'd79892ff-e33a-4a43-83d0-2110c0e588fb', '1b60a9f3-6d58-4eee-807d-77502940bde8'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:07 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:07 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:08 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.267s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f638bece-8bf1-4cdf-901e-4f38e9f30f5f tempest-VolumesGetTest-567869944 None] Lock "cinder-f121e1e1-ca66-4875-ba78-1c7d8ab82ebe-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (fb701788-5dbf-449b-88a0-ae5652d71acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2786050c-0d93-4691-81fd-ac2efde13cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2786050c-0d93-4691-81fd-ac2efde13cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-633426260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e19fa5-13ee-473d-beff-fba930d0320f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:09Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f47508-ad44-4ac5-a14e-ff05a792cfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f47508-ad44-4ac5-a14e-ff05a792cfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5974e6-4f56-4378-8fd2-204e0a40cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5974e6-4f56-4378-8fd2-204e0a40cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e19fa5-13ee-473d-beff-fba930d0320f', 'volume_name': 'volume-59e19fa5-13ee-473d-beff-fba930d0320f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f98d155-a4dd-4e4c-b209-b17ef52de499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f98d155-a4dd-4e4c-b209-b17ef52de499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673b0ee-f8f9-47fc-a01b-1d40d32d217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:08 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Volume 59e19fa5-13ee-473d-beff-fba930d0320f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e19fa5-13ee-473d-beff-fba930d0320f', 'volume_size': 1} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-633426260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e19fa5-13ee-473d-beff-fba930d0320f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:09Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Creating volume 59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:08 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:08 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f 1073741824 Jul 29 16:21:08 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:09 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f 1073741824" returned: 0 in 0.469s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:09 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:09 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:09 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673b0ee-f8f9-47fc-a01b-1d40d32d217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e19fa5-13ee-473d-beff-fba930d0320f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ccdec0-f4c2-42d2-84ab-d5a1d390fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:09 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Volume volume-59e19fa5-13ee-473d-beff-fba930d0320f (59e19fa5-13ee-473d-beff-fba930d0320f): created successfully Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ccdec0-f4c2-42d2-84ab-d5a1d390fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:09 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (fb701788-5dbf-449b-88a0-ae5652d71acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fb342bbc-e039-4a1e-9431-945d7fe24786 tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (ca162760-52d7-40fc-a8c5-0ac6176d88e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30a0642-a80a-44e9-a43b-4e4f64345b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30a0642-a80a-44e9-a43b-4e4f64345b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1128462908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=59e19fa5-13ee-473d-beff-fba930d0320f,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:10Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cded7637-7bf5-4522-bf1f-2c097892fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cded7637-7bf5-4522-bf1f-2c097892fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe33a7a-0968-4016-a7d8-3b15b474dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe33a7a-0968-4016-a7d8-3b15b474dac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba', 'volume_name': 'volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba', 'volume_size': 1, 'source_volid': '59e19fa5-13ee-473d-beff-fba930d0320f', 'source_volstatus': 'available'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e21748c-869c-498f-80b1-80af8667c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e21748c-869c-498f-80b1-80af8667c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fd06c7-ae3e-45cb-bcc9-0970e4c9def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Volume ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba', 'volume_size': 1, 'source_volid': '59e19fa5-13ee-473d-beff-fba930d0320f', 'source_volstatus': 'available'} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:10 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Cloning volume 59e19fa5-13ee-473d-beff-fba930d0320f to volume ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Creating offline snapshot 0babb10c-438d-4817-a5a1-e26c3f857e0e of volume 59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e58cf-2027-41ed-8a31-e7361db2fdc7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:10 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:10 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:10 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.381s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:10 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e 1G Jul 29 16:21:10 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:11 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e 1G" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e19fa5-13ee-473d-beff-fba930d0320f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:11 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e19fa5-13ee-473d-beff-fba930d0320f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e Jul 29 16:21:11 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:11 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e19fa5-13ee-473d-beff-fba930d0320f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:11 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e is being set with open permissions: ugo+rw Jul 29 16:21:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:11 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e Jul 29 16:21:11 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:11 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:11 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info Jul 29 16:21:11 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:12 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:12 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info is being set with open permissions: ugo+rw Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:12 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info Jul 29 16:21:12 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:12 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.info" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] snapshot: 0babb10c-438d-4817-a5a1-e26c3f857e0e, volume: ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4becd85e-954d-415b-9c8d-89f01401077e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:12 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e Jul 29 16:21:12 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:12 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e" returned: 0 in 0.410s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e19fa5-13ee-473d-beff-fba930d0320f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd3ed9-99af-4297-bcb5-c94e9bf5f912]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:12 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:12 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:13 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.390s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:13 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:21:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:13 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba Jul 29 16:21:13 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:17 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" returned: 0 in 4.153s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d43426e-2b82-4e58-82c2-7f44f0571733]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:17 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:17 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:17 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.555s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:17 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:21:17 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Converted 1024.00 MB image at 246.47 MB/s Jul 29 16:21:17 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba is being set with open permissions: ugo+rw Jul 29 16:21:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:18 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba Jul 29 16:21:18 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:18 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" returned: 0 in 0.242s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" released by "_copy_volume_from_snapshot" :: held 5.839s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-0babb10c-438d-4817-a5a1-e26c3f857e0e" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-0babb10c-438d-4817-a5a1-e26c3f857e0e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Deleting offline snapshot 0babb10c-438d-4817-a5a1-e26c3f857e0e of volume 59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] snapshot_file for this snap is: volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d56c61e-9610-4e51-a8a1-d220a977bcf4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:18 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e Jul 29 16:21:18 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:18 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e" returned: 0 in 0.351s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e19fa5-13ee-473d-beff-fba930d0320f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e159a0-2ddb-463c-9bca-69a480e0ffc1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:18 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:18 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:19 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.344s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:19 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e Jul 29 16:21:19 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:19 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e" returned: 0 in 0.337s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:19 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e Jul 29 16:21:19 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:19 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f.0babb10c-438d-4817-a5a1-e26c3f857e0e" returned: 0 in 0.246s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-0babb10c-438d-4817-a5a1-e26c3f857e0e" released by "_delete_snapshot" :: held 1.359s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.333s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fd06c7-ae3e-45cb-bcc9-0970e4c9def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba', 'volume_size': 1, 'source_volid': '59e19fa5-13ee-473d-beff-fba930d0320f', 'source_volstatus': 'available'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b1ffbd-2b9d-4684-a4e3-3ae6e53e0e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:19 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Volume volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba (ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba): created successfully Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b1ffbd-2b9d-4684-a4e3-3ae6e53e0e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (ca162760-52d7-40fc-a8c5-0ac6176d88e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cad77498-72f6-4754-9733-ed5d0fb5ebc1 tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (fe149712-28fe-402d-90c3-5948e4b853f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abe0704-e291-4cb1-8c38-55cbc2655544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abe0704-e291-4cb1-8c38-55cbc2655544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-750048282',display_name='tempest-VolumesGetTest-Volume-1374888655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4dce3e-f414-49a3-bf24-a8082f29540d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:20Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6e8fad-59f3-4f9a-8c1c-3d1bbba8ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6e8fad-59f3-4f9a-8c1c-3d1bbba8ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8fe55-64af-49c4-83dc-5c986b8c9803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8fe55-64af-49c4-83dc-5c986b8c9803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4dce3e-f414-49a3-bf24-a8082f29540d', 'volume_name': 'volume-dc4dce3e-f414-49a3-bf24-a8082f29540d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552afeda-500a-4552-8647-e058846c1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552afeda-500a-4552-8647-e058846c1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b13ba9e-feb7-4ffc-b68f-d3745d6a05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:20 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Volume dc4dce3e-f414-49a3-bf24-a8082f29540d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4dce3e-f414-49a3-bf24-a8082f29540d', 'volume_size': 1} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-750048282',display_name='tempest-VolumesGetTest-Volume-1374888655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4dce3e-f414-49a3-bf24-a8082f29540d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:20Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Creating volume dc4dce3e-f414-49a3-bf24-a8082f29540d {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:20 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:20 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d 1073741824 Jul 29 16:21:20 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:21 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d 1073741824" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:21 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d Jul 29 16:21:21 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:21 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b13ba9e-feb7-4ffc-b68f-d3745d6a05cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4dce3e-f414-49a3-bf24-a8082f29540d', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a47ccdc-f9c6-4663-aadf-fb7650163675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Volume volume-dc4dce3e-f414-49a3-bf24-a8082f29540d (dc4dce3e-f414-49a3-bf24-a8082f29540d): created successfully Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a47ccdc-f9c6-4663-aadf-fb7650163675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (fe149712-28fe-402d-90c3-5948e4b853f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1d58b8e7-2f01-4add-8389-4f528df9a2ac tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-dc4dce3e-f414-49a3-bf24-a8082f29540d-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Lock "cinder-dc4dce3e-f414-49a3-bf24-a8082f29540d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-dc4dce3e-f414-49a3-bf24-a8082f29540d" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-dc4dce3e-f414-49a3-bf24-a8082f29540d" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[286500ee-a1ca-4651-b3f6-e458331e4d4e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:21 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d Jul 29 16:21:21 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:22 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d" returned: 0 in 0.355s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:22 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d Jul 29 16:21:22 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:22 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc4dce3e-f414-49a3-bf24-a8082f29540d" returned: 0 in 0.236s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-dc4dce3e-f414-49a3-bf24-a8082f29540d" released by "delete_volume" :: held 0.629s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Created reservations ['7f0dfc67-e1d2-4227-ab86-13f326803384', 'c3045eec-6a92-4ae7-8889-7ddd759fd190', '9eb5c85d-31d6-4bdd-99d5-3decc78cf738', 'dbf65709-04f2-4839-ab31-2b7d01580eed'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:22 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:22 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:22 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.239s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a92bd851-871b-4d7f-83a3-88670f98bd3f tempest-VolumesGetTest-567869944 None] Lock "cinder-dc4dce3e-f414-49a3-bf24-a8082f29540d-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Lock "cinder-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe5ff27-b4d4-4ae2-9b9b-2514f194491a]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:23 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba Jul 29 16:21:23 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:23 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" returned: 0 in 0.343s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:23 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba Jul 29 16:21:23 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:23 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba" released by "delete_volume" :: held 0.636s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Created reservations ['8d0a6be6-930b-4773-973f-cdb74dfe8968', '784d2d05-74bc-44dc-bb7a-02d76021793a', '40c71342-b6cc-497b-8438-60d9e149596f', 'bf40cf5d-ec2e-4c4a-b206-590596403030'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:23 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:23 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:23 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a3f925b9-74a0-43f5-ae71-1cb35188d3cb tempest-VolumesGetTest-567869944 None] Lock "cinder-ef1f4129-8e9b-4e63-bfc0-9e3cf96e42ba-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-59e19fa5-13ee-473d-beff-fba930d0320f-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Lock "cinder-59e19fa5-13ee-473d-beff-fba930d0320f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-59e19fa5-13ee-473d-beff-fba930d0320f" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-59e19fa5-13ee-473d-beff-fba930d0320f" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305a465-b54b-4af1-8953-022545411a06]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:24 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:24 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:24 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.362s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:24 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f Jul 29 16:21:24 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:24 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-59e19fa5-13ee-473d-beff-fba930d0320f" returned: 0 in 0.243s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-59e19fa5-13ee-473d-beff-fba930d0320f" released by "delete_volume" :: held 0.665s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Created reservations ['1e410c76-a84c-4616-b4e8-9c73070b1ddd', 'a906afe5-ead8-4df9-91ec-020d628525b1', 'a8fda3a5-064d-4361-bdb0-eb68ab0a30e6', '5de9754b-204e-4c46-91bb-93d4d824b9cd'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:25 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:25 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:25 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:25 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-95402ea6-9f43-4362-85c5-81d106b4c7ba tempest-VolumesGetTest-567869944 None] Lock "cinder-59e19fa5-13ee-473d-beff-fba930d0320f-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (83f8f172-b275-4bb0-8e13-fa54e0087706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bdbd88-f5c3-4b9f-a7c9-0227bcc4b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bdbd88-f5c3-4b9f-a7c9-0227bcc4b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1868806216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c479d06c-2d6b-4df1-8b4d-64a72ceb190b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:26Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f01e37-ca55-4f79-bb60-cddf1a6c1470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f01e37-ca55-4f79-bb60-cddf1a6c1470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2bc65e-b58a-4322-9ee6-63db716993cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2bc65e-b58a-4322-9ee6-63db716993cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c479d06c-2d6b-4df1-8b4d-64a72ceb190b', 'volume_name': 'volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cdea74-1c06-40a4-b60d-ea60c63f7af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cdea74-1c06-40a4-b60d-ea60c63f7af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b4e877-e644-45f5-9ede-71a6f32bf785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Volume c479d06c-2d6b-4df1-8b4d-64a72ceb190b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Trying to clone c479d06c-2d6b-4df1-8b4d-64a72ceb190b from image 16778ff0-340b-4c4a-846b-47774617fa95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:21:26 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Image download 20.69 MB at 20.69 MB/s Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c5151-77a4-43c3-a411-857d348a2aa3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:26 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD Jul 29 16:21:26 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:27 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 is fetched for user a5a4abf49f1d4bb39b85c80cf96f1df0. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc98a134-67dc-4915-9c21-4f2b338c7647]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:27 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD Jul 29 16:21:27 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:27 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1868806216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c479d06c-2d6b-4df1-8b4d-64a72ceb190b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:26Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Creating volume c479d06c-2d6b-4df1-8b4d-64a72ceb190b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:27 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:27 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b 1073741824 Jul 29 16:21:27 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:27 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b 1073741824" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:28 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b Jul 29 16:21:28 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:28 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Attempting download of 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume c479d06c-2d6b-4df1-8b4d-64a72ceb190b. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb4b1ac-ef0b-45a0-88bc-8cba0e430d57]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:28 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x Jul 29 16:21:28 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:28 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x" returned: 0 in 0.328s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:28 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x Jul 29 16:21:28 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:29 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x" returned: 1 in 0.335s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_16778ff0-340b-4c4a-846b-47774617fa95_mbmv5j7x' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6287154-1dc9-4c97-b11d-4bfc4e42e7b2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:29 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD Jul 29 16:21:29 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:29 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] 16778ff0-340b-4c4a-846b-47774617fa95 was qcow2, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:21:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:29 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b Jul 29 16:21:29 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:30 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" returned: 0 in 1.562s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:30 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_16778ff0-340b-4c4a-846b-47774617fa95_otoi39_9devstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:21:30 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Converted 112.00 MB image at 71.66 MB/s Jul 29 16:21:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:30 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b 1G Jul 29 16:21:30 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:31 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b 1G" returned: 0 in 0.312s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Downloaded image 16778ff0-340b-4c4a-846b-47774617fa95 ((None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}])) to volume c479d06c-2d6b-4df1-8b4d-64a72ceb190b successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Temporary image 16778ff0-340b-4c4a-846b-47774617fa95 for user a5a4abf49f1d4bb39b85c80cf96f1df0 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Marking volume c479d06c-2d6b-4df1-8b4d-64a72ceb190b as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Copying metadata from image 16778ff0-340b-4c4a-846b-47774617fa95 to c479d06c-2d6b-4df1-8b4d-64a72ceb190b. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Creating volume glance metadata for volume c479d06c-2d6b-4df1-8b4d-64a72ceb190b backed by image 16778ff0-340b-4c4a-846b-47774617fa95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b4e877-e644-45f5-9ede-71a6f32bf785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b', 'volume_size': 1, 'image_id': '16778ff0-340b-4c4a-846b-47774617fa95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/16778ff0-340b-4c4a-846b-47774617fa95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa1022533d37498daaf9b1a90f3ab443', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '16778ff0-340b-4c4a-846b-47774617fa95', 'created_at': datetime.datetime(2026, 7, 29, 13, 56, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 13, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/16778ff0-340b-4c4a-846b-47774617fa95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b45ddd-d5e4-4844-9d10-00bc1dc5fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:31 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Volume volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b (c479d06c-2d6b-4df1-8b4d-64a72ceb190b): created successfully Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b45ddd-d5e4-4844-9d10-00bc1dc5fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (83f8f172-b275-4bb0-8e13-fa54e0087706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-18da8cf2-dac4-4e2d-9359-6ffd5c1f3945 tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (b67279a4-528b-49dd-bdc4-9c6ed1b3953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e968f-e0f1-46ab-b049-bcc2357f9bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e968f-e0f1-46ab-b049-bcc2357f9bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-35211328',display_name='tempest-VolumesGetTest-Volume-341841953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5d877d-a8b8-4b78-98e1-b9cda38e4520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:33Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f7ef6-c6f9-41e0-aec3-2a5fd1c37a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f7ef6-c6f9-41e0-aec3-2a5fd1c37a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7164385f-0980-4d59-8301-b83b95feecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7164385f-0980-4d59-8301-b83b95feecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5d877d-a8b8-4b78-98e1-b9cda38e4520', 'volume_name': 'volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7941f478-e387-4851-8cca-8e82125cc1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7941f478-e387-4851-8cca-8e82125cc1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6371db-c7f0-49b4-bae1-95e7549d24c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Volume 1a5d877d-a8b8-4b78-98e1-b9cda38e4520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520', 'volume_size': 1} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-35211328',display_name='tempest-VolumesGetTest-Volume-341841953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5d877d-a8b8-4b78-98e1-b9cda38e4520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee46a4cb6fe472cbb666f23cbfc15e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:33Z,use_quota=True,user_id='a5a4abf49f1d4bb39b85c80cf96f1df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Creating volume 1a5d877d-a8b8-4b78-98e1-b9cda38e4520 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:33 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:33 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 1073741824 Jul 29 16:21:33 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:33 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 1073741824" returned: 0 in 0.403s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:33 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 Jul 29 16:21:33 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:33 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6371db-c7f0-49b4-bae1-95e7549d24c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77ab805-e04e-47ea-8672-d4a281173d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Volume volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 (1a5d877d-a8b8-4b78-98e1-b9cda38e4520): created successfully Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77ab805-e04e-47ea-8672-d4a281173d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Flow 'volume_create_manager' (b67279a4-528b-49dd-bdc4-9c6ed1b3953b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c665181e-b614-41b3-a264-ac5a5dfbb02e tempest-VolumesGetTest-567869944 None] Created volume successfully. Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-1a5d877d-a8b8-4b78-98e1-b9cda38e4520-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Lock "cinder-1a5d877d-a8b8-4b78-98e1-b9cda38e4520-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-1a5d877d-a8b8-4b78-98e1-b9cda38e4520" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-1a5d877d-a8b8-4b78-98e1-b9cda38e4520" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86c08f-296c-47ce-ab17-488772656b90]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:34 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 Jul 29 16:21:34 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:34 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520" returned: 0 in 0.364s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:34 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520 Jul 29 16:21:34 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:34 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-1a5d877d-a8b8-4b78-98e1-b9cda38e4520" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-1a5d877d-a8b8-4b78-98e1-b9cda38e4520" released by "delete_volume" :: held 0.646s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:34 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Created reservations ['b3e5867f-b2da-4b85-9952-aa11d27dbcf9', '9c722419-e8e1-4e65-a7d4-9a2e06976afc', '35b4e12e-edec-47d9-aae5-b80f9baffeaa', '9bb8a40a-49f3-4dd5-9a09-47b7c58a71a9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:35 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:35 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:35 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.236s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ecf13aba-b2e1-4306-91e1-73d3e86f26cf tempest-VolumesGetTest-567869944 None] Lock "cinder-1a5d877d-a8b8-4b78-98e1-b9cda38e4520-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-c479d06c-2d6b-4df1-8b4d-64a72ceb190b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Lock "cinder-c479d06c-2d6b-4df1-8b4d-64a72ceb190b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Acquiring lock "cinder-quobyte-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f6d7b3-5973-48ac-97da-0171b06317db]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:35 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b Jul 29 16:21:35 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:35 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:35 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b Jul 29 16:21:35 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:36 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Lock "cinder-quobyte-c479d06c-2d6b-4df1-8b4d-64a72ceb190b" released by "delete_volume" :: held 0.651s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=120,cinder:INSERT=37,cinder:DELETE=10,cinder:SELECT=82 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Created reservations ['8b3fff72-30c5-4823-9bc4-1cd4a9189db6', '55e6616f-3b17-49f0-bab2-76cca0c1f6a6', '17d68497-5610-435f-89aa-e39eeb1faf36', '7d1bb948-be91-4063-9d5f-999c0774745d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:36 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:36 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:36 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.243s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Deleted volume successfully. Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-6f245221-c3b6-49a8-a975-bf522fcf3f81 tempest-VolumesGetTest-567869944 None] Lock "cinder-c479d06c-2d6b-4df1-8b4d-64a72ceb190b-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:36 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:36 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:36 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.241s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Flow 'volume_create_manager' (81b1ea72-cb0f-4df4-9906-c73c72f3f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781d970f-0878-40f4-9292-754c8c3298dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781d970f-0878-40f4-9292-754c8c3298dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1245090746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098be76c-aec1-49e4-8445-18b2d248f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c73f2f61a04cd99b9edf150bba092a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:41Z,use_quota=True,user_id='7953efe8b6e047e2bd9c414cbe4d67c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55376de6-a2dd-4291-85ec-87afc82b27df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55376de6-a2dd-4291-85ec-87afc82b27df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baefca91-13c1-40b4-83c0-4e3ecbabed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baefca91-13c1-40b4-83c0-4e3ecbabed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098be76c-aec1-49e4-8445-18b2d248f05b', 'volume_name': 'volume-098be76c-aec1-49e4-8445-18b2d248f05b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db893a7-4040-454a-ba36-eecf3d5911c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db893a7-4040-454a-ba36-eecf3d5911c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff4790e-a5f9-4eb9-92ef-067364c005c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Volume 098be76c-aec1-49e4-8445-18b2d248f05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098be76c-aec1-49e4-8445-18b2d248f05b', 'volume_size': 1} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1245090746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098be76c-aec1-49e4-8445-18b2d248f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c73f2f61a04cd99b9edf150bba092a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:41Z,use_quota=True,user_id='7953efe8b6e047e2bd9c414cbe4d67c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Creating volume 098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:41 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:41 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b 1073741824 Jul 29 16:21:41 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:42 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b 1073741824" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:42 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:42 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:42 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff4790e-a5f9-4eb9-92ef-067364c005c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098be76c-aec1-49e4-8445-18b2d248f05b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a8cfe2-acea-4142-ad42-f5536668b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:42 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Volume volume-098be76c-aec1-49e4-8445-18b2d248f05b (098be76c-aec1-49e4-8445-18b2d248f05b): created successfully Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a8cfe2-acea-4142-ad42-f5536668b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Flow 'volume_create_manager' (81b1ea72-cb0f-4df4-9906-c73c72f3f732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:42 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9148d5cf-2847-48ba-86bd-6a086885079c tempest-VolumeDependencyTests-1448795901 None] Created volume successfully. Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Creating offline snapshot 3342d15f-57ee-4de9-adde-d56d0eb9b243 of volume 098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419df9c-3050-47ee-b534-7138d6cd1f91]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:42 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:42 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:43 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:43 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 1G Jul 29 16:21:43 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:43 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 1G" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098be76c-aec1-49e4-8445-18b2d248f05b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:43 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098be76c-aec1-49e4-8445-18b2d248f05b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 Jul 29 16:21:43 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:43 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098be76c-aec1-49e4-8445-18b2d248f05b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243" returned: 0 in 0.296s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:43 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 is being set with open permissions: ugo+rw Jul 29 16:21:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:43 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 Jul 29 16:21:43 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:44 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243" returned: 0 in 0.241s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:44 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info Jul 29 16:21:44 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:44 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:44 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info is being set with open permissions: ugo+rw Jul 29 16:21:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:44 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info Jul 29 16:21:44 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:44 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.info" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-986e084d-e85b-4776-99b9-c4c9cc852063 tempest-VolumeDependencyTests-1448795901 None] Create snapshot completed successfully Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Flow 'volume_create_manager' (b04e727e-2ce0-480b-bb01-4ead26c366a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f14527-14c4-4c40-91ad-a16ed188623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f14527-14c4-4c40-91ad-a16ed188623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1735949955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b113fab3-00ee-4e45-8ba0-1424d81ae747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c73f2f61a04cd99b9edf150bba092a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3342d15f-57ee-4de9-adde-d56d0eb9b243,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:45Z,use_quota=True,user_id='7953efe8b6e047e2bd9c414cbe4d67c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ebf65c-409a-4b1a-8e76-760ee951ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ebf65c-409a-4b1a-8e76-760ee951ee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28890e9-2a07-4f3f-a159-9464bb415a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28890e9-2a07-4f3f-a159-9464bb415a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b113fab3-00ee-4e45-8ba0-1424d81ae747', 'volume_name': 'volume-b113fab3-00ee-4e45-8ba0-1424d81ae747', 'volume_size': 1, 'snapshot_id': '3342d15f-57ee-4de9-adde-d56d0eb9b243'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712660ee-7ff3-4c67-9b60-4cacac153f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712660ee-7ff3-4c67-9b60-4cacac153f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532968df-50b7-4ba8-b993-4530c63d7854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:45 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Volume b113fab3-00ee-4e45-8ba0-1424d81ae747: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b113fab3-00ee-4e45-8ba0-1424d81ae747', 'volume_size': 1, 'snapshot_id': '3342d15f-57ee-4de9-adde-d56d0eb9b243'} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-quobyte-3342d15f-57ee-4de9-adde-d56d0eb9b243-b113fab3-00ee-4e45-8ba0-1424d81ae747" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-3342d15f-57ee-4de9-adde-d56d0eb9b243-b113fab3-00ee-4e45-8ba0-1424d81ae747" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Creating volume b113fab3-00ee-4e45-8ba0-1424d81ae747 from snapshot 3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-quobyte-b113fab3-00ee-4e45-8ba0-1424d81ae747" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-b113fab3-00ee-4e45-8ba0-1424d81ae747" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] snapshot: 3342d15f-57ee-4de9-adde-d56d0eb9b243, volume: b113fab3-00ee-4e45-8ba0-1424d81ae747, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624f5f8-0dc7-465c-8271-f7a52750c651]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:45 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 Jul 29 16:21:45 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:45 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243" returned: 0 in 0.354s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-098be76c-aec1-49e4-8445-18b2d248f05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d709c3a-4bc8-4cd9-903c-4e85061de79e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:46 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:46 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:46 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.370s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:46 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:21:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:46 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 Jul 29 16:21:46 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:50 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747" returned: 0 in 4.151s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:50 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f09bc3-6650-48dd-bf5a-a9e0b1538be2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:50 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:50 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:50 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.567s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:21:51 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Converted 1024.00 MB image at 246.61 MB/s Jul 29 16:21:51 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 is being set with open permissions: ugo+rw Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:51 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 Jul 29 16:21:51 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:51 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747" returned: 0 in 0.259s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-b113fab3-00ee-4e45-8ba0-1424d81ae747" released by "_copy_volume_from_snapshot" :: held 5.794s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-3342d15f-57ee-4de9-adde-d56d0eb9b243-b113fab3-00ee-4e45-8ba0-1424d81ae747" released by "_create_volume_from_snapshot" :: held 5.822s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.836s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532968df-50b7-4ba8-b993-4530c63d7854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b113fab3-00ee-4e45-8ba0-1424d81ae747', 'volume_size': 1, 'snapshot_id': '3342d15f-57ee-4de9-adde-d56d0eb9b243'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43d11cb-3d45-43e9-883a-a43e6ac3b031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:51 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Volume volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 (b113fab3-00ee-4e45-8ba0-1424d81ae747): created successfully Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43d11cb-3d45-43e9-883a-a43e6ac3b031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Flow 'volume_create_manager' (b04e727e-2ce0-480b-bb01-4ead26c366a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a4c93368-5ee8-4ee6-9b26-56552efae520 tempest-VolumeDependencyTests-1448795901 None] Created volume successfully. Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-3342d15f-57ee-4de9-adde-d56d0eb9b243-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-3342d15f-57ee-4de9-adde-d56d0eb9b243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-quobyte-098be76c-aec1-49e4-8445-18b2d248f05b" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-098be76c-aec1-49e4-8445-18b2d248f05b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-quobyte-3342d15f-57ee-4de9-adde-d56d0eb9b243" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-3342d15f-57ee-4de9-adde-d56d0eb9b243" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Deleting offline snapshot 3342d15f-57ee-4de9-adde-d56d0eb9b243 of volume 098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] snapshot_file for this snap is: volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[44491673-67c4-4827-ad32-07e0da82b6fc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:52 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 Jul 29 16:21:52 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:52 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-098be76c-aec1-49e4-8445-18b2d248f05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc316c8d-bbd4-460c-9688-703550b126d9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:52 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:52 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:52 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.365s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:52 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 Jul 29 16:21:52 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:53 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243" returned: 0 in 0.345s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:53 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243 Jul 29 16:21:53 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:53 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b.3342d15f-57ee-4de9-adde-d56d0eb9b243" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-3342d15f-57ee-4de9-adde-d56d0eb9b243" released by "_delete_snapshot" :: held 1.452s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-098be76c-aec1-49e4-8445-18b2d248f05b" released by "delete_snapshot" :: held 1.479s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Created reservations ['de8e5e2a-b53f-4a7b-a7db-4ce2804717c9', '646931cb-3838-44e5-bd73-94c5486da107', '33e63266-3f8b-44c9-a80b-fe398f740a63', 'cee626a3-3790-4de2-9528-21484cdb9196'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Delete snapshot completed successfully. Jul 29 16:21:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e38d4ca-bfb6-4e20-8215-549fcabe7e15 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-3342d15f-57ee-4de9-adde-d56d0eb9b243-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-098be76c-aec1-49e4-8445-18b2d248f05b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-098be76c-aec1-49e4-8445-18b2d248f05b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-quobyte-098be76c-aec1-49e4-8445-18b2d248f05b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-098be76c-aec1-49e4-8445-18b2d248f05b" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac335e-bcbc-4a98-9894-db5a22d17421]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:54 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:54 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:54 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.354s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:54 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b Jul 29 16:21:54 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:54 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-098be76c-aec1-49e4-8445-18b2d248f05b" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-098be76c-aec1-49e4-8445-18b2d248f05b" released by "delete_volume" :: held 0.664s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=111,cinder:SELECT=88,cinder:DELETE=11,cinder:INSERT=30 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:21:54 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Created reservations ['f8ede755-7397-40ed-a88a-cf5beb0e64a0', '74b7c57d-d090-4930-bea9-23ea7c25f17a', '99bc607d-0468-479a-9d9c-27b22718c9d7', '91833f0c-a723-42c8-b86b-9273f36711f2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:55 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:55 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:55 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:55 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Deleted volume successfully. Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-16e67a8c-b815-4d88-90b8-13af7a361aee tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-098be76c-aec1-49e4-8445-18b2d248f05b-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-b113fab3-00ee-4e45-8ba0-1424d81ae747-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-b113fab3-00ee-4e45-8ba0-1424d81ae747-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "cinder-quobyte-b113fab3-00ee-4e45-8ba0-1424d81ae747" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-b113fab3-00ee-4e45-8ba0-1424d81ae747" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[555dfa47-2020-44c8-8f41-9e0d3114e877]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:55 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 Jul 29 16:21:55 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:55 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747" returned: 0 in 0.374s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:55 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747 Jul 29 16:21:55 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:56 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b113fab3-00ee-4e45-8ba0-1424d81ae747" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-quobyte-b113fab3-00ee-4e45-8ba0-1424d81ae747" released by "delete_volume" :: held 0.671s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Created reservations ['1e225cd5-b1e3-4f7f-b9b9-24c4a378b388', 'dab0991f-b486-4b63-b1f1-b374dc296f5e', '61b60637-8f9d-4eb6-87b3-b39184a06bf9', '6586000b-46d8-476f-b244-dd11b29694f4'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:56 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:21:56 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:56 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.259s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:21:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Deleted volume successfully. Jul 29 16:21:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-9fd09d31-8b76-45fa-849c-c8a4575b6c71 tempest-VolumeDependencyTests-1448795901 None] Lock "cinder-b113fab3-00ee-4e45-8ba0-1424d81ae747-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Flow 'volume_create_manager' (49a0ddf0-107b-4b50-b0c4-4a00f6152d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5597583f-9305-4db8-a2da-523007fe7600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5597583f-9305-4db8-a2da-523007fe7600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdaed4f-7afd-4ff3-8117-5f4ba562d250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b9a54244d94499a478caa02eaaf87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:59Z,use_quota=True,user_id='34b8b262884e4e168e1808e3ec729490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ede4924-9c9c-4139-9c94-018fd07ce85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ede4924-9c9c-4139-9c94-018fd07ce85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fdb0f3-969c-47cc-a56e-3d8f7a91213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fdb0f3-969c-47cc-a56e-3d8f7a91213a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbdaed4f-7afd-4ff3-8117-5f4ba562d250', 'volume_name': 'volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ededd084-82aa-4203-9f5b-2fbe6162cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ededd084-82aa-4203-9f5b-2fbe6162cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5514262a-637b-4906-8a45-65d239816bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:21:59 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Volume fbdaed4f-7afd-4ff3-8117-5f4ba562d250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250', 'volume_size': 1} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdaed4f-7afd-4ff3-8117-5f4ba562d250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b9a54244d94499a478caa02eaaf87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:21:59Z,use_quota=True,user_id='34b8b262884e4e168e1808e3ec729490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Creating volume fbdaed4f-7afd-4ff3-8117-5f4ba562d250 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:21:59 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:59 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 1073741824 Jul 29 16:21:59 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:21:59 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 1073741824" returned: 0 in 0.397s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:21:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:21:59 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 Jul 29 16:21:59 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:00 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250" returned: 0 in 0.231s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5514262a-637b-4906-8a45-65d239816bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927621f2-2717-4955-84a7-42d127326b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:00 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Volume volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 (fbdaed4f-7afd-4ff3-8117-5f4ba562d250): created successfully Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927621f2-2717-4955-84a7-42d127326b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Flow 'volume_create_manager' (49a0ddf0-107b-4b50-b0c4-4a00f6152d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0caf4f3d-1e14-45e8-84f5-46a5c65ef304 tempest-CinderUnicodeTest-1822249612 None] Created volume successfully. Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Flow 'volume_create_manager' (01288935-419a-4327-b829-e4286253b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2836d0d2-eb14-454e-b1c6-baa41ed6129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2836d0d2-eb14-454e-b1c6-baa41ed6129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:22:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1549190841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e116af01-ec08-42e4-8f13-62460cd9e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b9a54244d94499a478caa02eaaf87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:22:01Z,use_quota=True,user_id='34b8b262884e4e168e1808e3ec729490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6417e4-de81-4f7e-85c1-32a0638e742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6417e4-de81-4f7e-85c1-32a0638e742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45915095-2759-4ca6-bb1f-68a6d430e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45915095-2759-4ca6-bb1f-68a6d430e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e116af01-ec08-42e4-8f13-62460cd9e017', 'volume_name': 'volume-e116af01-ec08-42e4-8f13-62460cd9e017', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0031292-4709-442b-84fb-bd9ef4c34882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0031292-4709-442b-84fb-bd9ef4c34882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd74422-7ba4-40ff-ac0f-657f697150a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:00 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Volume e116af01-ec08-42e4-8f13-62460cd9e017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e116af01-ec08-42e4-8f13-62460cd9e017', 'volume_size': 1} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:22:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1549190841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e116af01-ec08-42e4-8f13-62460cd9e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b9a54244d94499a478caa02eaaf87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:22:01Z,use_quota=True,user_id='34b8b262884e4e168e1808e3ec729490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Creating volume e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:22:00 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:22:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:01 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 1073741824 Jul 29 16:22:01 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:01 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 1073741824" returned: 0 in 0.427s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:01 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 Jul 29 16:22:01 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:01 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd74422-7ba4-40ff-ac0f-657f697150a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e116af01-ec08-42e4-8f13-62460cd9e017', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b61dfba-cb0f-4e04-a970-23cbec3d72a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Volume volume-e116af01-ec08-42e4-8f13-62460cd9e017 (e116af01-ec08-42e4-8f13-62460cd9e017): created successfully Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b61dfba-cb0f-4e04-a970-23cbec3d72a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Flow 'volume_create_manager' (01288935-419a-4327-b829-e4286253b834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:01 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6f5bd36a-b51b-440b-b2ae-f80d65c625e6 tempest-CinderUnicodeTest-1822249612 None] Created volume successfully. Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Creating offline snapshot 14704fd6-11db-43df-ae89-ba21e9979a96 of volume e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a75e42-e97f-4080-92aa-f562244459be]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:02 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 Jul 29 16:22:02 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:02 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017" returned: 0 in 0.377s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:02 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 1G Jul 29 16:22:02 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:02 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 1G" returned: 0 in 0.387s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e116af01-ec08-42e4-8f13-62460cd9e017 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:02 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e116af01-ec08-42e4-8f13-62460cd9e017 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 Jul 29 16:22:02 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:03 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e116af01-ec08-42e4-8f13-62460cd9e017 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:03 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 is being set with open permissions: ugo+rw Jul 29 16:22:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:03 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 Jul 29 16:22:03 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:03 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96" returned: 0 in 0.241s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:03 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info Jul 29 16:22:03 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:03 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info" returned: 0 in 0.264s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:03 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info is being set with open permissions: ugo+rw Jul 29 16:22:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:03 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info Jul 29 16:22:03 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:04 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.info" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-39e3db19-f1c3-4d2e-a0a3-eed795a3bc3c tempest-CinderUnicodeTest-1822249612 None] Create snapshot completed successfully Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-14704fd6-11db-43df-ae89-ba21e9979a96-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-14704fd6-11db-43df-ae89-ba21e9979a96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-quobyte-e116af01-ec08-42e4-8f13-62460cd9e017" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-e116af01-ec08-42e4-8f13-62460cd9e017" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-quobyte-14704fd6-11db-43df-ae89-ba21e9979a96" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-14704fd6-11db-43df-ae89-ba21e9979a96" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Deleting offline snapshot 14704fd6-11db-43df-ae89-ba21e9979a96 of volume e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] snapshot_file for this snap is: volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[674e7ed6-4557-43b2-9e93-66a42b731bb2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:04 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 Jul 29 16:22:04 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:04 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96" returned: 0 in 0.365s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e116af01-ec08-42e4-8f13-62460cd9e017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd4c7c0-8cb9-4278-b905-3bbe13b0817d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:04 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 Jul 29 16:22:04 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:05 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017" returned: 0 in 0.342s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:05 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 Jul 29 16:22:05 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:05 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96" returned: 0 in 0.326s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:05 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96 Jul 29 16:22:05 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:05 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017.14704fd6-11db-43df-ae89-ba21e9979a96" returned: 0 in 0.241s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-14704fd6-11db-43df-ae89-ba21e9979a96" released by "_delete_snapshot" :: held 1.372s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-e116af01-ec08-42e4-8f13-62460cd9e017" released by "delete_snapshot" :: held 1.394s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Created reservations ['afb6c608-f54d-47ac-bf0c-8800de51fad3', 'da3d39d4-8e82-4350-bc1d-ff81c52f696a', 'e6741c83-f890-4294-9d24-96e2ee63c807', '0f7554c1-5d2d-4454-9446-8789b3260f9d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:22:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Delete snapshot completed successfully. Jul 29 16:22:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec5056b7-32bb-44a7-abe9-d3602a38e80e tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-14704fd6-11db-43df-ae89-ba21e9979a96-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-e116af01-ec08-42e4-8f13-62460cd9e017-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-e116af01-ec08-42e4-8f13-62460cd9e017-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-quobyte-e116af01-ec08-42e4-8f13-62460cd9e017" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-e116af01-ec08-42e4-8f13-62460cd9e017" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b623bc-a6a9-4467-93ef-2fe9c3b5d7d0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:06 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 Jul 29 16:22:06 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:06 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017" returned: 0 in 0.359s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:06 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017 Jul 29 16:22:06 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:07 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e116af01-ec08-42e4-8f13-62460cd9e017" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-e116af01-ec08-42e4-8f13-62460cd9e017" released by "delete_volume" :: held 0.666s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Created reservations ['7ecd6b2f-5ea7-440d-b40e-ab81907684cf', 'b0d56491-3777-4840-8f6a-122ac7690b27', '3a183d3d-56ab-456b-8e26-a63d1e387d83', '5135bbcb-2dfc-43d5-ab66-555d0c5041b0'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:07 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:22:07 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:07 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:22:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Deleted volume successfully. Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-0ce96082-4473-4554-842c-8d635e2eae5f tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-e116af01-ec08-42e4-8f13-62460cd9e017-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-fbdaed4f-7afd-4ff3-8117-5f4ba562d250-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-fbdaed4f-7afd-4ff3-8117-5f4ba562d250-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "cinder-quobyte-fbdaed4f-7afd-4ff3-8117-5f4ba562d250" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-fbdaed4f-7afd-4ff3-8117-5f4ba562d250" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a58054-0e19-46bc-a5d8-b28139d1fc49]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:07 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 Jul 29 16:22:07 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:08 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250" returned: 0 in 0.355s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:08 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250 Jul 29 16:22:08 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:08 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fbdaed4f-7afd-4ff3-8117-5f4ba562d250" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-quobyte-fbdaed4f-7afd-4ff3-8117-5f4ba562d250" released by "delete_volume" :: held 0.647s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Created reservations ['df61c991-47f1-47ee-b46c-21027c89b076', '157199dd-a7e0-4b47-94a8-e97ffee4cee1', '1eb64012-e33f-44a4-a08f-8354cf32d566', '946c7e87-832c-48c6-b1a9-2b59b052f953'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:08 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:22:08 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:08 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:22:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Deleted volume successfully. Jul 29 16:22:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-05db7ee7-4d8a-414d-820a-b0067faf0094 tempest-CinderUnicodeTest-1822249612 None] Lock "cinder-fbdaed4f-7afd-4ff3-8117-5f4ba562d250-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:18 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=30,cinder:INSERT=13,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:22:18 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=63,cinder:SELECT=53,cinder:DELETE=4,cinder:INSERT=12 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Flow 'volume_create_manager' (15774373-e4f4-4d2c-ab3d-df1e10b04903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32364d76-ef62-4067-b006-0f7f10cb1884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32364d76-ef62-4067-b006-0f7f10cb1884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1621673970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a1c713-2b94-4ff1-8295-3ee9b403ebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b370aa10649cb81cd438ea3cd5d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:22:36Z,use_quota=True,user_id='0194396487c147298e38ea1e40690133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a225035f-e659-4993-a34d-95df088c4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a225035f-e659-4993-a34d-95df088c4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee4abe1-7821-4e9a-9daa-e18e5eed60e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee4abe1-7821-4e9a-9daa-e18e5eed60e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a1c713-2b94-4ff1-8295-3ee9b403ebd5', 'volume_name': 'volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6635923-3ac4-49e7-a171-aaa6be95b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6635923-3ac4-49e7-a171-aaa6be95b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d1fdc2-bd2f-4884-9db9-f0313c617ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:36 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Volume 77a1c713-2b94-4ff1-8295-3ee9b403ebd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5', 'volume_size': 1} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1621673970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a1c713-2b94-4ff1-8295-3ee9b403ebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b370aa10649cb81cd438ea3cd5d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:22:36Z,use_quota=True,user_id='0194396487c147298e38ea1e40690133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Creating volume 77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:22:36 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:36 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 1073741824 Jul 29 16:22:36 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:36 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:22:36 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:37 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:22:37 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 1073741824" returned: 0 in 0.438s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:37 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:37 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:37 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.251s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d1fdc2-bd2f-4884-9db9-f0313c617ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5d272b-4812-453e-a761-b74f6666e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Volume volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 (77a1c713-2b94-4ff1-8295-3ee9b403ebd5): created successfully Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5d272b-4812-453e-a761-b74f6666e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Flow 'volume_create_manager' (15774373-e4f4-4d2c-ab3d-df1e10b04903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-745549a4-fb57-4324-a051-350695605be9 tempest-SnapshotDependencyTests-1685582610 None] Created volume successfully. Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Creating offline snapshot 328a4374-6346-4385-88a1-20edbad28d0b of volume 77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bebd19-c6f8-4c89-aa2f-a86578bd8b95]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:38 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:38 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:38 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.349s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:38 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b 1G Jul 29 16:22:38 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:38 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b 1G" returned: 0 in 0.381s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:38 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b Jul 29 16:22:38 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:39 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:39 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b is being set with open permissions: ugo+rw Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:39 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b Jul 29 16:22:39 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:39 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b" returned: 0 in 0.242s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:39 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info Jul 29 16:22:39 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:39 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:39 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info is being set with open permissions: ugo+rw Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:39 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info Jul 29 16:22:39 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:39 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.info" returned: 0 in 0.236s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:39 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-46a39d21-46e7-4deb-845a-4f95d17cd064 tempest-SnapshotDependencyTests-1685582610 None] Create snapshot completed successfully Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Flow 'volume_create_manager' (c78b2218-a265-453b-beaa-a66594badf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc61e7bb-67ad-49b5-9ec3-4844fca09add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc61e7bb-67ad-49b5-9ec3-4844fca09add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54e5a70-726a-4a9d-906f-1915147b30c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b370aa10649cb81cd438ea3cd5d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=328a4374-6346-4385-88a1-20edbad28d0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:22:41Z,use_quota=True,user_id='0194396487c147298e38ea1e40690133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a45458-87dc-468e-8677-9f27939bcde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a45458-87dc-468e-8677-9f27939bcde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b39ca2b-4568-43af-8d4e-22c088c9f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b39ca2b-4568-43af-8d4e-22c088c9f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f54e5a70-726a-4a9d-906f-1915147b30c2', 'volume_name': 'volume-f54e5a70-726a-4a9d-906f-1915147b30c2', 'volume_size': 1, 'snapshot_id': '328a4374-6346-4385-88a1-20edbad28d0b'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc799807-2be2-403e-af42-950a1a4d8cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc799807-2be2-403e-af42-950a1a4d8cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa99e511-56d1-4e68-8289-e0a3c8ad60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:40 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Volume f54e5a70-726a-4a9d-906f-1915147b30c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f54e5a70-726a-4a9d-906f-1915147b30c2', 'volume_size': 1, 'snapshot_id': '328a4374-6346-4385-88a1-20edbad28d0b'} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-quobyte-328a4374-6346-4385-88a1-20edbad28d0b-f54e5a70-726a-4a9d-906f-1915147b30c2" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-328a4374-6346-4385-88a1-20edbad28d0b-f54e5a70-726a-4a9d-906f-1915147b30c2" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Creating volume f54e5a70-726a-4a9d-906f-1915147b30c2 from snapshot 328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-quobyte-f54e5a70-726a-4a9d-906f-1915147b30c2" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-f54e5a70-726a-4a9d-906f-1915147b30c2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] snapshot: 328a4374-6346-4385-88a1-20edbad28d0b, volume: f54e5a70-726a-4a9d-906f-1915147b30c2, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6dbd5-0b60-459d-abbe-2fb82b345c09]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:40 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b Jul 29 16:22:40 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:41 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b" returned: 0 in 0.355s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b00e2-7257-47dc-a76c-f8b8258f96f3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:41 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:41 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:41 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:22:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:41 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 Jul 29 16:22:41 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:45 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2" returned: 0 in 4.172s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443369f-860d-4793-b3f1-271b46ba7c62]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:45 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:45 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:46 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.527s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:22:46 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Converted 1024.00 MB image at 245.35 MB/s Jul 29 16:22:46 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 is being set with open permissions: ugo+rw Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:46 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 Jul 29 16:22:46 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:46 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-f54e5a70-726a-4a9d-906f-1915147b30c2" released by "_copy_volume_from_snapshot" :: held 5.757s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-328a4374-6346-4385-88a1-20edbad28d0b-f54e5a70-726a-4a9d-906f-1915147b30c2" released by "_create_volume_from_snapshot" :: held 5.787s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.801s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa99e511-56d1-4e68-8289-e0a3c8ad60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54e5a70-726a-4a9d-906f-1915147b30c2', 'volume_size': 1, 'snapshot_id': '328a4374-6346-4385-88a1-20edbad28d0b'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba66ac34-36b1-4494-9335-c7e85ce7da1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:22:46 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Volume volume-f54e5a70-726a-4a9d-906f-1915147b30c2 (f54e5a70-726a-4a9d-906f-1915147b30c2): created successfully Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba66ac34-36b1-4494-9335-c7e85ce7da1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:22:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Flow 'volume_create_manager' (c78b2218-a265-453b-beaa-a66594badf20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:22:46 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-93aefb69-7db5-4f3e-b16b-d3f27fa5d7f1 tempest-SnapshotDependencyTests-1685582610 None] Created volume successfully. Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-328a4374-6346-4385-88a1-20edbad28d0b-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-328a4374-6346-4385-88a1-20edbad28d0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-quobyte-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-quobyte-328a4374-6346-4385-88a1-20edbad28d0b" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-328a4374-6346-4385-88a1-20edbad28d0b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Deleting offline snapshot 328a4374-6346-4385-88a1-20edbad28d0b of volume 77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] snapshot_file for this snap is: volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3579c5-7dac-45fc-a8f1-6f7a3239a95e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:47 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b Jul 29 16:22:47 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:47 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b" returned: 0 in 0.357s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9fb4e2-d727-4aae-b914-abf3d2ca7771]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:47 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:47 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:48 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:48 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b Jul 29 16:22:48 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:48 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b" returned: 0 in 0.326s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:48 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b Jul 29 16:22:48 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:48 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5.328a4374-6346-4385-88a1-20edbad28d0b" returned: 0 in 0.238s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-328a4374-6346-4385-88a1-20edbad28d0b" released by "_delete_snapshot" :: held 1.358s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" released by "delete_snapshot" :: held 1.381s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Created reservations ['c4dba3eb-026d-4c8f-ab91-294ab78b1d72', '9b0a96e2-a57f-4b7f-ba36-651ded223532', 'd77836c9-d135-4ce8-9984-75064f157720', '956c59a8-856b-41a3-b9d9-e48b67e585d4'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:22:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Delete snapshot completed successfully. Jul 29 16:22:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4da7a0f0-fcd2-419d-ac78-639dd2c6b399 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-328a4374-6346-4385-88a1-20edbad28d0b-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-77a1c713-2b94-4ff1-8295-3ee9b403ebd5-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-77a1c713-2b94-4ff1-8295-3ee9b403ebd5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-quobyte-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b46f954-7f3b-4f33-bbd6-1fbe4e44a142]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:49 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:49 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:49 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.356s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:49 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5 Jul 29 16:22:49 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:50 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" returned: 0 in 0.237s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-77a1c713-2b94-4ff1-8295-3ee9b403ebd5" released by "delete_volume" :: held 0.657s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Created reservations ['d506f8c7-648b-4e9a-bebd-c8d1b84fe4c9', '1f5a7ebe-c539-4870-8aa3-71531ddd9ce1', '6d9552be-9f4d-41a1-ae75-1c097e2de323', '49033460-1070-48fd-ab6b-b14fc887ecda'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:50 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:22:50 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:50 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:22:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Deleted volume successfully. Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1148fb1c-61c1-401a-bb34-aba4972dd600 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-77a1c713-2b94-4ff1-8295-3ee9b403ebd5-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-f54e5a70-726a-4a9d-906f-1915147b30c2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-f54e5a70-726a-4a9d-906f-1915147b30c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "cinder-quobyte-f54e5a70-726a-4a9d-906f-1915147b30c2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-f54e5a70-726a-4a9d-906f-1915147b30c2" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4169c760-1a9c-4f68-ae25-579b2321ecbc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:22:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:50 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 Jul 29 16:22:50 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:51 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2" returned: 0 in 0.368s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:51 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2 Jul 29 16:22:51 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:51 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-f54e5a70-726a-4a9d-906f-1915147b30c2" returned: 0 in 0.267s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-quobyte-f54e5a70-726a-4a9d-906f-1915147b30c2" released by "delete_volume" :: held 0.677s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Created reservations ['ef4c3f2e-8acb-43af-9e68-c202a2859de7', '3123e471-4f60-43da-94a5-0f112334a326', 'd2587aa2-02b2-4624-8dd6-3c1da6821193', '4a5e7d75-e322-412d-9b85-4be809c49867'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:22:51 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:22:51 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:22:51 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.290s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:22:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Deleted volume successfully. Jul 29 16:22:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf794d86-8ce4-416d-8836-99eeff632a95 tempest-SnapshotDependencyTests-1685582610 None] Lock "cinder-f54e5a70-726a-4a9d-906f-1915147b30c2-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:23:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (c37ff988-f8e6-479a-8100-2a6585fa6baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fd278e-6611-4ce9-b5dc-149aae113085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fd278e-6611-4ce9-b5dc-149aae113085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601342376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9430bcaf-c46e-4a7e-bc79-ba63bd51c37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:11Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25874f41-86cd-40c0-8283-703931733bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25874f41-86cd-40c0-8283-703931733bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b7f8ec-e895-465c-a288-de045d7f5732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b7f8ec-e895-465c-a288-de045d7f5732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9430bcaf-c46e-4a7e-bc79-ba63bd51c37e', 'volume_name': 'volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5beac164-1cde-49f4-9e70-20846ff89d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5beac164-1cde-49f4-9e70-20846ff89d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b381904a-e155-4dd9-be45-6aeb620298d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume 9430bcaf-c46e-4a7e-bc79-ba63bd51c37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e', 'volume_size': 1} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601342376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9430bcaf-c46e-4a7e-bc79-ba63bd51c37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:11Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Creating volume 9430bcaf-c46e-4a7e-bc79-ba63bd51c37e {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:11 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:11 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e 1073741824 Jul 29 16:23:11 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (31d093f5-1225-48a1-88b7-635a8aad9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e929ee2f-b53d-4053-8e11-2e26d6a17e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e929ee2f-b53d-4053-8e11-2e26d6a17e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96073214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7be984-b380-4f97-b2d9-630a405137cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0eb8d3-d21d-48a4-a7e9-dfbcc38d78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0eb8d3-d21d-48a4-a7e9-dfbcc38d78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b5513a-7b5d-4724-af6c-37e2bb19e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b5513a-7b5d-4724-af6c-37e2bb19e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7be984-b380-4f97-b2d9-630a405137cf', 'volume_name': 'volume-fa7be984-b380-4f97-b2d9-630a405137cf', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63e86e1-8578-476e-9981-a05a0c5501f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63e86e1-8578-476e-9981-a05a0c5501f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67afed45-4789-425f-87f3-1acfff15c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Volume fa7be984-b380-4f97-b2d9-630a405137cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7be984-b380-4f97-b2d9-630a405137cf', 'volume_size': 1} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (b0fad735-aea4-46a0-8652-853a706f983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b749a48-d83c-4823-98f2-8aabd1940e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b749a48-d83c-4823-98f2-8aabd1940e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-570673489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4530c093-36c2-4f80-aecc-9adb3ca89ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67267681-a4bc-4b32-bba5-a7e892dca1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67267681-a4bc-4b32-bba5-a7e892dca1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8156c342-7b4c-44f3-95d8-d728538d4304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8156c342-7b4c-44f3-95d8-d728538d4304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4530c093-36c2-4f80-aecc-9adb3ca89ba2', 'volume_name': 'volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17dc513-de9a-4598-a449-7fbcb4b5779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17dc513-de9a-4598-a449-7fbcb4b5779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f8385d-b6e7-49ed-840e-cc0276cca71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Volume 4530c093-36c2-4f80-aecc-9adb3ca89ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2', 'volume_size': 1} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:12 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e 1073741824" returned: 0 in 0.761s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (8e935913-67cf-4eb3-896f-2faaf682e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab78121-6590-431c-b4fb-80ecf9199b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Flow 'volume_create_manager' (bd00ee6a-2bcd-4a33-89f2-e0562bd128ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df36f00-8589-4ea2-a300-334517ee2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab78121-6590-431c-b4fb-80ecf9199b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-740595887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92d79a5-c339-4c7a-8958-2f8721ac2ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6650f3a1-af20-46bf-9692-0c7dbcce5d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6650f3a1-af20-46bf-9692-0c7dbcce5d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e3f3fd-7e02-4a89-b79f-65d05829e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e3f3fd-7e02-4a89-b79f-65d05829e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92d79a5-c339-4c7a-8958-2f8721ac2ad5', 'volume_name': 'volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35650253-1225-4164-ac68-dbb57bddedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35650253-1225-4164-ac68-dbb57bddedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9e49ee-146b-4eb3-9691-eac051b57d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Volume b92d79a5-c339-4c7a-8958-2f8721ac2ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5', 'volume_size': 1} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df36f00-8589-4ea2-a300-334517ee2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-531624262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f08e887-c3fe-4d08-a6fd-b7a7be919f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3f08bda503439c935a3fcfc3639f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='3c2fa325fe994aec9209f003a3b0f253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441c9842-ce2c-4b15-b44c-747be244335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441c9842-ce2c-4b15-b44c-747be244335a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a1afb7-3290-4958-866d-d5c95eede750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a1afb7-3290-4958-866d-d5c95eede750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f08e887-c3fe-4d08-a6fd-b7a7be919f7f', 'volume_name': 'volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7c2cd0-229f-4391-9661-fc9352ddd092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7c2cd0-229f-4391-9661-fc9352ddd092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc60103-ddb2-4d56-a81d-5290c9a6f7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Volume 2f08e887-c3fe-4d08-a6fd-b7a7be919f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f', 'volume_size': 1} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:12 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e Jul 29 16:23:12 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (58c9ebd8-61ed-48b4-9291-e4cb433cc982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58995268-bd7f-4f82-bb30-0ca30e724149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58995268-bd7f-4f82-bb30-0ca30e724149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548691303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b6fba1-c30f-4d73-b734-0e60f7dcc4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:13Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fdf474-9105-450f-9167-a5c5ec4e0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fdf474-9105-450f-9167-a5c5ec4e0961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06eec1d8-ae21-4903-b10c-aca484c702e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06eec1d8-ae21-4903-b10c-aca484c702e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b6fba1-c30f-4d73-b734-0e60f7dcc4db', 'volume_name': 'volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b1a29b-558c-4809-8f95-e09ea8e28bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b1a29b-558c-4809-8f95-e09ea8e28bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6e9942-fa1d-45ec-8638-13ab39b84d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Volume 35b6fba1-c30f-4d73-b734-0e60f7dcc4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db', 'volume_size': 1} Jul 29 16:23:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:13 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e" returned: 0 in 0.300s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96073214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7be984-b380-4f97-b2d9-630a405137cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Creating volume fa7be984-b380-4f97-b2d9-630a405137cf {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:13 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:13 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf 1073741824 Jul 29 16:23:13 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b381904a-e155-4dd9-be45-6aeb620298d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0d678f-90cc-457e-b8fb-2690fb0e840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:13 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e (9430bcaf-c46e-4a7e-bc79-ba63bd51c37e): created successfully Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0d678f-90cc-457e-b8fb-2690fb0e840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (c37ff988-f8e6-479a-8100-2a6585fa6baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:13 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f65e5870-3acb-40f9-993b-29d2b107c680 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created volume successfully. Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (cb09e665-e51e-4ae6-b83f-35e04caf6e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8970b2e1-b260-48f9-832f-a5f270ad7201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8970b2e1-b260-48f9-832f-a5f270ad7201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088041435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb94a71-62a1-4211-aee8-475b44e36384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:13Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacc9be4-b3c1-4e0c-8679-4c4196389cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacc9be4-b3c1-4e0c-8679-4c4196389cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96105da3-70a7-459b-a8b1-4844b711c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96105da3-70a7-459b-a8b1-4844b711c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb94a71-62a1-4211-aee8-475b44e36384', 'volume_name': 'volume-5eb94a71-62a1-4211-aee8-475b44e36384', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538786a4-b8fc-4d68-983d-2aeea6d6616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538786a4-b8fc-4d68-983d-2aeea6d6616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91780c4-4759-4dbf-bd45-21f6b010def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:13 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Volume 5eb94a71-62a1-4211-aee8-475b44e36384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb94a71-62a1-4211-aee8-475b44e36384', 'volume_size': 1} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:13 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf 1073741824" returned: 0 in 0.589s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:13 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf Jul 29 16:23:13 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:13 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:14 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (b37c36e1-2007-4619-b59f-c96ca42e9652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d398cb1-b603-4b37-b1f2-080b94ac4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf" returned: 0 in 0.339s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.954s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-570673489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4530c093-36c2-4f80-aecc-9adb3ca89ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Creating volume 4530c093-36c2-4f80-aecc-9adb3ca89ba2 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:14 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d398cb1-b603-4b37-b1f2-080b94ac4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111866512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24620519-b168-49ef-bd7d-e4f3ac8ca8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:14Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285f053b-b596-457e-afde-0cd2806a9ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285f053b-b596-457e-afde-0cd2806a9ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 1073741824 Jul 29 16:23:14 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374215a3-cca7-489f-ac6e-d0f2fedf1e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374215a3-cca7-489f-ac6e-d0f2fedf1e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24620519-b168-49ef-bd7d-e4f3ac8ca8b2', 'volume_name': 'volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f7fffd-0fa0-4e4a-8242-8858c03b586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f7fffd-0fa0-4e4a-8242-8858c03b586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd8df8a-d166-4826-b54e-81a5e3aadf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume 24620519-b168-49ef-bd7d-e4f3ac8ca8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2', 'volume_size': 1} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67afed45-4789-425f-87f3-1acfff15c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7be984-b380-4f97-b2d9-630a405137cf', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96984b-66ab-41d7-b617-0b8391145c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Volume volume-fa7be984-b380-4f97-b2d9-630a405137cf (fa7be984-b380-4f97-b2d9-630a405137cf): created successfully Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96984b-66ab-41d7-b617-0b8391145c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (31d093f5-1225-48a1-88b7-635a8aad9290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0e30ac57-eec0-4f7d-9e22-fe96cb81132b tempest-CreateVolumesFromImageTest-666581070 None] Created volume successfully. Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (81b52f91-e414-4b9d-b17f-3617e2c01bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be44e03-0fa8-44d3-bb9b-63be284b8355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be44e03-0fa8-44d3-bb9b-63be284b8355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669932321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7603387e-2629-4b43-b0fa-25de7b781f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:14Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ade2a0-f5d3-4499-903c-cc1826d4a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ade2a0-f5d3-4499-903c-cc1826d4a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80308c8d-de42-48d8-a24f-af4c9f30c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80308c8d-de42-48d8-a24f-af4c9f30c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7603387e-2629-4b43-b0fa-25de7b781f4e', 'volume_name': 'volume-7603387e-2629-4b43-b0fa-25de7b781f4e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3197c06c-afa5-4326-b65a-dd819ba6ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3197c06c-afa5-4326-b65a-dd819ba6ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963efae8-b01d-43d9-810b-45a4d1d1fdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume 7603387e-2629-4b43-b0fa-25de7b781f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7603387e-2629-4b43-b0fa-25de7b781f4e', 'volume_size': 1} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:14 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 1073741824" returned: 0 in 0.638s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:14 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 Jul 29 16:23:14 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (4c674810-399c-4cdc-8216-ff0447ba99a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41518edb-7530-42bd-8bba-ed4698bd8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41518edb-7530-42bd-8bba-ed4698bd8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635254930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b66bb67-8d86-494b-ac0b-8764372a0033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:15Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3e2ecd-44ca-42b5-9221-8c5872abd2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3e2ecd-44ca-42b5-9221-8c5872abd2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f95b2b-d4a6-4af6-8a4f-99e715f1bffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f95b2b-d4a6-4af6-8a4f-99e715f1bffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b66bb67-8d86-494b-ac0b-8764372a0033', 'volume_name': 'volume-3b66bb67-8d86-494b-ac0b-8764372a0033', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5814b338-a98e-42bc-8666-ee426031ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5814b338-a98e-42bc-8666-ee426031ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d04aaa-d5a4-4aa4-a6d2-23acd16f899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume 3b66bb67-8d86-494b-ac0b-8764372a0033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b66bb67-8d86-494b-ac0b-8764372a0033', 'volume_size': 1} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:15 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2" returned: 0 in 0.321s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-740595887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92d79a5-c339-4c7a-8958-2f8721ac2ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Creating volume b92d79a5-c339-4c7a-8958-2f8721ac2ad5 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:15 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f8385d-b6e7-49ed-840e-cc0276cca71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85794641-8fdb-48ba-9aad-f73dc7811f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 1073741824 Jul 29 16:23:15 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Volume volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 (4530c093-36c2-4f80-aecc-9adb3ca89ba2): created successfully Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85794641-8fdb-48ba-9aad-f73dc7811f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (b0fad735-aea4-46a0-8652-853a706f983e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-57f95371-5214-4f54-88f1-82da2a1f8690 tempest-CreateVolumesFromImageTest-666581070 None] Created volume successfully. Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (7e220c8b-289c-4c37-a1c0-053089019511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98879a46-276b-404d-9504-04a4f62b431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98879a46-276b-404d-9504-04a4f62b431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-771617957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c199ae-5ab7-4ffd-9770-ceaad13c8bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:15Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0638bc-d6e6-4f1c-8cf9-4c77da8ecf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0638bc-d6e6-4f1c-8cf9-4c77da8ecf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50df0eb-31a2-4001-8605-9f0d032843f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50df0eb-31a2-4001-8605-9f0d032843f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c199ae-5ab7-4ffd-9770-ceaad13c8bcc', 'volume_name': 'volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2453666c-5193-463e-bce2-73a2194de9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2453666c-5193-463e-bce2-73a2194de9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09b5d00-b921-42c5-b890-b32ce72a071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume 19c199ae-5ab7-4ffd-9770-ceaad13c8bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc', 'volume_size': 1} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:15 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 1073741824" returned: 0 in 0.658s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:15 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 Jul 29 16:23:15 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (c7a1998a-702c-4caa-baee-45c82996865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d2751b-9892-4ad7-a566-3e26dc82e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d2751b-9892-4ad7-a566-3e26dc82e50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844767655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2239ef80-30cd-469a-ad02-e6b8a6f7875f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:16Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8338af31-6db1-4813-987a-93ad7825e996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8338af31-6db1-4813-987a-93ad7825e996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e5a1a2-676b-474d-adb8-21e331ffe810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e5a1a2-676b-474d-adb8-21e331ffe810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2239ef80-30cd-469a-ad02-e6b8a6f7875f', 'volume_name': 'volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3affdcaf-b145-407a-bbb3-989aab6eaa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3affdcaf-b145-407a-bbb3-989aab6eaa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89948401-2540-43ad-9b96-77ff80847e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume 2239ef80-30cd-469a-ad02-e6b8a6f7875f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f', 'volume_size': 1} Jul 29 16:23:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:16 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5" returned: 0 in 0.300s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-531624262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f08e887-c3fe-4d08-a6fd-b7a7be919f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3f08bda503439c935a3fcfc3639f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:12Z,use_quota=True,user_id='3c2fa325fe994aec9209f003a3b0f253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Creating volume 2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:16 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9e49ee-146b-4eb3-9691-eac051b57d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:16 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f 1073741824 Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9feb8792-4a8a-4840-aaac-e78d81ff78be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:16 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:16 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Volume volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 (b92d79a5-c339-4c7a-8958-2f8721ac2ad5): created successfully Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9feb8792-4a8a-4840-aaac-e78d81ff78be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (8e935913-67cf-4eb3-896f-2faaf682e21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-09a161b0-82a4-4a80-8cf1-c6ab9f735585 tempest-CreateVolumesFromImageTest-666581070 None] Created volume successfully. Jul 29 16:23:16 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f 1073741824" returned: 0 in 0.519s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:16 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:16 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Flow 'volume_create_manager' (166ecf44-0806-4921-b5d3-481366740744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dd4bd3-bbde-41ac-b6fc-cec5c7a725f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dd4bd3-bbde-41ac-b6fc-cec5c7a725f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67811882-1ddf-4a84-b720-13d194804c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b8973d6b94fd3bfa7a45f04fb5c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:17Z,use_quota=True,user_id='5924bf596e3a4099b917943cfd6a8913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d1c3eb5-0d5e-4551-9019-804a7a0e62c8),volume_type_id=3d1c3eb5-0d5e-4551-9019-804a7a0e62c8)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f077d5a1-f046-432a-a364-98e5b2052972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f077d5a1-f046-432a-a364-98e5b2052972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb1b367-3961-45a5-811a-0cabae5807a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:23:16 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.306s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.994s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548691303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b6fba1-c30f-4d73-b734-0e60f7dcc4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:13Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Creating volume 35b6fba1-c30f-4d73-b734-0e60f7dcc4db {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:16 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc60103-ddb2-4d56-a81d-5290c9a6f7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da20314e-f8f0-46cb-baba-7dc9d8faf237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:16 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db 1073741824 Jul 29 16:23:16 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Volume volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f (2f08e887-c3fe-4d08-a6fd-b7a7be919f7f): created successfully Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da20314e-f8f0-46cb-baba-7dc9d8faf237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Flow 'volume_create_manager' (bd00ee6a-2bcd-4a33-89f2-e0562bd128ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-41056c9f-24fc-498d-814d-c8068b428283 tempest-VolumeDependencyTests-308026860 None] Created volume successfully. Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb1b367-3961-45a5-811a-0cabae5807a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67811882-1ddf-4a84-b720-13d194804c85', 'volume_name': 'volume-67811882-1ddf-4a84-b720-13d194804c85', 'volume_size': 1, 'image_id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f64959b2-ca9c-4b65-a242-a60b75db5f87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93bf16846c3ef8ad27566095185eca04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b09b8973d6b94fd3bfa7a45f04fb5c72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6683082ee73d05351d4f3f4ec95d4e1fcd80f6769e9b2ec2ccaf35f8e9f15c22f34d3c12963555ba6e0e78f82bbd38b95770563e57099b3d420f9333ebe7a7ec', 'id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'created_at': datetime.datetime(2026, 7, 29, 14, 23, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 23, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f64959b2-ca9c-4b65-a242-a60b75db5f87/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802bc473-784a-4208-9ed2-22fc0a6f3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802bc473-784a-4208-9ed2-22fc0a6f3765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07653f63-9f8a-4755-a64c-527aaca56ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Volume 67811882-1ddf-4a84-b720-13d194804c85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67811882-1ddf-4a84-b720-13d194804c85', 'volume_size': 1, 'image_id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f64959b2-ca9c-4b65-a242-a60b75db5f87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93bf16846c3ef8ad27566095185eca04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b09b8973d6b94fd3bfa7a45f04fb5c72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6683082ee73d05351d4f3f4ec95d4e1fcd80f6769e9b2ec2ccaf35f8e9f15c22f34d3c12963555ba6e0e78f82bbd38b95770563e57099b3d420f9333ebe7a7ec', 'id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'created_at': datetime.datetime(2026, 7, 29, 14, 23, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 23, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f64959b2-ca9c-4b65-a242-a60b75db5f87/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Trying to clone 67811882-1ddf-4a84-b720-13d194804c85 from image f64959b2-ca9c-4b65-a242-a60b75db5f87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f64959b2-ca9c-4b65-a242-a60b75db5f87', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Image download 0.00 MB at 0.00 MB/s Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c818d50b-6f37-4831-9866-267d36b374a0]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:17 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db 1073741824" returned: 0 in 0.485s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:17 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD Jul 29 16:23:17 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:17 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db Jul 29 16:23:17 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:17 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:17 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db" returned: 0 in 0.267s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.333s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088041435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb94a71-62a1-4211-aee8-475b44e36384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee4ac532d724995916be0152294aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:13Z,use_quota=True,user_id='72fbfddc88e1461592efe4f991f9c847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Creating volume 5eb94a71-62a1-4211-aee8-475b44e36384 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6e9942-fa1d-45ec-8638-13ab39b84d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:17 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 1073741824 Jul 29 16:23:17 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ba47d8-de28-498f-9789-49523fce616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Volume volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db (35b6fba1-c30f-4d73-b734-0e60f7dcc4db): created successfully Jul 29 16:23:17 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD Jul 29 16:23:17 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ba47d8-de28-498f-9789-49523fce616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (58c9ebd8-61ed-48b4-9291-e4cb433cc982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8dab4241-4bea-4d16-afd9-939cacf2a57c tempest-CreateVolumesFromImageTest-666581070 None] Created volume successfully. Jul 29 16:23:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:18 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Temporary image f64959b2-ca9c-4b65-a242-a60b75db5f87 is fetched for user 5924bf596e3a4099b917943cfd6a8913. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[39670bef-50ee-4e63-9d64-23f8b6dc3806]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:18 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 1073741824" returned: 0 in 0.499s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:18 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD Jul 29 16:23:18 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:18 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 Jul 29 16:23:18 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:18 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:18 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384" returned: 0 in 0.237s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.414s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111866512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24620519-b168-49ef-bd7d-e4f3ac8ca8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:14Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Creating volume 24620519-b168-49ef-bd7d-e4f3ac8ca8b2 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:18 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:18 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 1073741824 Jul 29 16:23:18 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91780c4-4759-4dbf-bd45-21f6b010def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb94a71-62a1-4211-aee8-475b44e36384', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da04152-50ac-4566-bb94-7616a413f79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:18 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Volume volume-5eb94a71-62a1-4211-aee8-475b44e36384 (5eb94a71-62a1-4211-aee8-475b44e36384): created successfully Jul 29 16:23:18 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD Jul 29 16:23:18 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da04152-50ac-4566-bb94-7616a413f79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Flow 'volume_create_manager' (cb09e665-e51e-4ae6-b83f-35e04caf6e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c7ba0b9b-45d5-4964-a413-d3f552a0837d tempest-CreateVolumesFromImageTest-666581070 None] Created volume successfully. Jul 29 16:23:18 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:23:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:19 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 1073741824" returned: 0 in 0.458s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:19 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 Jul 29 16:23:19 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-5eb94a71-62a1-4211-aee8-475b44e36384-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-5eb94a71-62a1-4211-aee8-475b44e36384-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-quobyte-5eb94a71-62a1-4211-aee8-475b44e36384" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-5eb94a71-62a1-4211-aee8-475b44e36384" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c822da3-d074-48b9-a076-ac13cf6d69c4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:19 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 Jul 29 16:23:19 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:19 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2" returned: 0 in 0.270s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669932321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7603387e-2629-4b43-b0fa-25de7b781f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:14Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Creating volume 7603387e-2629-4b43-b0fa-25de7b781f4e {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:19 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd8df8a-d166-4826-b54e-81a5e3aadf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:19 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e 1073741824 Jul 29 16:23:19 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdcdac2-2372-486c-8b8a-ebd7e92dad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:19 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 (24620519-b168-49ef-bd7d-e4f3ac8ca8b2): created successfully Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdcdac2-2372-486c-8b8a-ebd7e92dad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (b37c36e1-2007-4619-b59f-c96ca42e9652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6b20d00c-dffe-460c-b6a6-cd1dbb0e0209 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created volume successfully. Jul 29 16:23:19 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:19 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384 Jul 29 16:23:19 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:19 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e 1073741824" returned: 0 in 0.468s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:19 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5eb94a71-62a1-4211-aee8-475b44e36384" returned: 0 in 0.282s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-5eb94a71-62a1-4211-aee8-475b44e36384" released by "delete_volume" :: held 0.697s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:19 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e Jul 29 16:23:19 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Created reservations ['2ecb750a-bf6a-4611-840b-54c3bfe65192', '6a0c9136-1181-4ed6-8de8-e703a78c2c53', 'd625fa98-43c0-4bc4-b67f-0a423d9ca827', 'a308bfaf-7cdc-4c50-8ccb-c651a622d6a2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:20 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:20 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:20 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.098s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635254930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b66bb67-8d86-494b-ac0b-8764372a0033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:15Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Creating volume 3b66bb67-8d86-494b-ac0b-8764372a0033 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:20 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963efae8-b01d-43d9-810b-45a4d1d1fdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7603387e-2629-4b43-b0fa-25de7b781f4e', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:20 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 1073741824 Jul 29 16:23:20 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfb7caf-22a6-4d90-8e61-38d430dcc0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:20 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume volume-7603387e-2629-4b43-b0fa-25de7b781f4e (7603387e-2629-4b43-b0fa-25de7b781f4e): created successfully Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfb7caf-22a6-4d90-8e61-38d430dcc0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (81b52f91-e414-4b9d-b17f-3617e2c01bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-935b0fc1-5cca-4748-9d48-659f8d19fa88 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created volume successfully. Jul 29 16:23:20 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.264s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-35b6fba1-c30f-4d73-b734-0e60f7dcc4db-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Deleted volume successfully. Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-35b6fba1-c30f-4d73-b734-0e60f7dcc4db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f3aabf3c-3e08-4427-8d61-d977f05b8647 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-5eb94a71-62a1-4211-aee8-475b44e36384-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-quobyte-35b6fba1-c30f-4d73-b734-0e60f7dcc4db" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-35b6fba1-c30f-4d73-b734-0e60f7dcc4db" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c3c76-153a-4bd8-837a-d6f558d2977e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:20 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db Jul 29 16:23:20 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:20 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 1073741824" returned: 0 in 0.472s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:20 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 Jul 29 16:23:20 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:20 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:20 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db Jul 29 16:23:20 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:20 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.415s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-771617957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c199ae-5ab7-4ffd-9770-ceaad13c8bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:15Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Creating volume 19c199ae-5ab7-4ffd-9770-ceaad13c8bcc {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:20 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d04aaa-d5a4-4aa4-a6d2-23acd16f899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b66bb67-8d86-494b-ac0b-8764372a0033', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:20 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc 1073741824 Jul 29 16:23:20 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:20 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef0b483-1729-4c38-8101-78ee3a3e211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume volume-3b66bb67-8d86-494b-ac0b-8764372a0033 (3b66bb67-8d86-494b-ac0b-8764372a0033): created successfully Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef0b483-1729-4c38-8101-78ee3a3e211c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (4c674810-399c-4cdc-8216-ff0447ba99a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a618a14a-98b2-4fcb-b467-3ac8dd7078da tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created volume successfully. Jul 29 16:23:21 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-35b6fba1-c30f-4d73-b734-0e60f7dcc4db" returned: 0 in 0.284s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-35b6fba1-c30f-4d73-b734-0e60f7dcc4db" released by "delete_volume" :: held 0.735s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Created reservations ['10d3f7a5-da39-4fc5-8e9d-83c44d18ede8', '0467f1f8-bc14-40ff-9720-6de523d6665e', 'c0519eae-2bbf-41a2-82c3-3ceac8fb2c52', 'e24b6e72-702b-4bb3-8444-be841a9eb008'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:21 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:21 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-b92d79a5-c339-4c7a-8958-2f8721ac2ad5-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:21 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc 1073741824" returned: 0 in 0.531s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-b92d79a5-c339-4c7a-8958-2f8721ac2ad5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:21 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.307s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-quobyte-b92d79a5-c339-4c7a-8958-2f8721ac2ad5" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Deleted volume successfully. Jul 29 16:23:21 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc Jul 29 16:23:21 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-b92d79a5-c339-4c7a-8958-2f8721ac2ad5" acquired by "delete_volume" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf3e94ca-6b5b-4f9b-b4b4-dd64d2500c0c tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-35b6fba1-c30f-4d73-b734-0e60f7dcc4db-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae682362-d379-4f7b-a602-290a2c96192f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:21 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 Jul 29 16:23:21 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:21 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.931s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844767655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2239ef80-30cd-469a-ad02-e6b8a6f7875f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de48368c98049f39579230fbdce28af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:16Z,use_quota=True,user_id='cd2a628c4eaf401cb3b1987dfec75579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Creating volume 2239ef80-30cd-469a-ad02-e6b8a6f7875f {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:21 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09b5d00-b921-42c5-b890-b32ce72a071b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c2cdde-4f15-4d49-9582-b36717969f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:21 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f 1073741824 Jul 29 16:23:21 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc (19c199ae-5ab7-4ffd-9770-ceaad13c8bcc): created successfully Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c2cdde-4f15-4d49-9582-b36717969f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (7e220c8b-289c-4c37-a1c0-053089019511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b5407ce3-4208-408f-8f9f-78449be10041 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created volume successfully. Jul 29 16:23:22 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:22 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5 Jul 29 16:23:22 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:22 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b92d79a5-c339-4c7a-8958-2f8721ac2ad5" returned: 0 in 0.296s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:22 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f 1073741824" returned: 0 in 0.493s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-b92d79a5-c339-4c7a-8958-2f8721ac2ad5" released by "delete_volume" :: held 0.755s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:22 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Created reservations ['b86e1b48-9160-427b-bd8e-99220024b5fe', '758adf9f-1dfa-45b5-95cf-b0ec6716f61f', '65d78f40-c137-4a10-ac3c-cbceca530b86', '44138cfe-d281-46dc-a2e4-a7a2412dcbd6'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:22 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:22 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:22 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-4530c093-36c2-4f80-aecc-9adb3ca89ba2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:22 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-4530c093-36c2-4f80-aecc-9adb3ca89ba2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f" returned: 0 in 0.302s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.738s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89948401-2540-43ad-9b96-77ff80847e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a17bfb-4700-4631-be14-dde7e76b08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Creating offline snapshot 797df377-b729-4d25-90b4-b10fe8343cdc of volume 2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:23:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Volume volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f (2239ef80-30cd-469a-ad02-e6b8a6f7875f): created successfully Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a17bfb-4700-4631-be14-dde7e76b08e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Flow 'volume_create_manager' (c7a1998a-702c-4caa-baee-45c82996865d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5d00af-66b0-4332-a30e-d40fe9e0f06c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:22 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-quobyte-4530c093-36c2-4f80-aecc-9adb3ca89ba2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.300s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a09a04b4-bafc-4be9-ac44-ed8fe67ab464 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created volume successfully. Jul 29 16:23:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Deleted volume successfully. Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-4530c093-36c2-4f80-aecc-9adb3ca89ba2" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2aec60f5-6961-4e76-82ff-aa7cb686f0f6 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-b92d79a5-c339-4c7a-8958-2f8721ac2ad5-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf661db-9b66-4855-a491-3438607e185b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:22 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:22 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 Jul 29 16:23:23 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.381s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:23 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc 1G Jul 29 16:23:23 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2" returned: 0 in 0.387s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:23 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2 Jul 29 16:23:23 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4530c093-36c2-4f80-aecc-9adb3ca89ba2" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-4530c093-36c2-4f80-aecc-9adb3ca89ba2" released by "delete_volume" :: held 0.708s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-2239ef80-30cd-469a-ad02-e6b8a6f7875f-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Created reservations ['0e0d568e-8656-43a1-873a-a1ddc82391fa', '9fa051ed-2bf7-4404-8e61-3890b37376cb', '103cb782-2404-49f5-acd5-c47ca05654e5', '2b0a014f-b7c1-4666-97b2-6266db92a568'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-2239ef80-30cd-469a-ad02-e6b8a6f7875f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:23 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc 1G" returned: 0 in 0.490s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:23 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc Jul 29 16:23:23 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-quobyte-2239ef80-30cd-469a-ad02-e6b8a6f7875f" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-2239ef80-30cd-469a-ad02-e6b8a6f7875f" acquired by "delete_volume" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d7ce7-d567-4aac-b621-5d90320bae68]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:23 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:23 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-fa7be984-b380-4f97-b2d9-630a405137cf-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-fa7be984-b380-4f97-b2d9-630a405137cf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:23 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f Jul 29 16:23:23 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "cinder-quobyte-fa7be984-b380-4f97-b2d9-630a405137cf" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-fa7be984-b380-4f97-b2d9-630a405137cf" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358920e-c3fe-485e-8200-2ba91bae7fcc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc" returned: 0 in 0.404s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc is being set with open permissions: ugo+rw Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc Jul 29 16:23:24 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf Jul 29 16:23:24 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.379s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Deleted volume successfully. Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-18cd3d97-83a0-4361-ad46-724362b27af5 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-4530c093-36c2-4f80-aecc-9adb3ca89ba2-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:24 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f" returned: 0 in 0.490s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f Jul 29 16:23:24 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc" returned: 0 in 0.304s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info Jul 29 16:23:24 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf" returned: 0 in 0.469s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf Jul 29 16:23:24 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2239ef80-30cd-469a-ad02-e6b8a6f7875f" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-2239ef80-30cd-469a-ad02-e6b8a6f7875f" released by "delete_volume" :: held 0.820s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created reservations ['3fdcd262-6dab-4421-a72d-4ffc6b97f43a', '0d0a3baf-1414-40ed-8101-c266361bd959', '37fe7653-7b59-4740-8d2c-a4798d74b6a0', '6dcc8bfe-93f8-4354-b58e-f3b069972829'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:24 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info" returned: 0 in 0.318s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info is being set with open permissions: ugo+rw Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:24 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:24 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info Jul 29 16:23:24 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:24 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fa7be984-b380-4f97-b2d9-630a405137cf" returned: 0 in 0.298s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-quobyte-fa7be984-b380-4f97-b2d9-630a405137cf" released by "delete_volume" :: held 0.819s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Created reservations ['ff5316f6-83fc-4450-803c-75356ea77afa', '38c7360e-b28d-48c9-ac85-4e4122490283', '47d9bd0e-0952-40fc-94df-f0bcd3be8aba', '8699f8d8-28ec-456c-aedf-c9ed2ca81480'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-quobyte-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc" acquired by "delete_volume" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bc9b58-5d07-469e-b44c-aec6e2bd0ab1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:25 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:25 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.info" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.354s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:25 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:25 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Deleted volume successfully. Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.278s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67811882-1ddf-4a84-b720-13d194804c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b8973d6b94fd3bfa7a45f04fb5c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:17Z,use_quota=True,user_id='5924bf596e3a4099b917943cfd6a8913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d1c3eb5-0d5e-4551-9019-804a7a0e62c8),volume_type_id=3d1c3eb5-0d5e-4551-9019-804a7a0e62c8)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Creating volume 67811882-1ddf-4a84-b720-13d194804c85 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:25 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:25 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 1073741824 Jul 29 16:23:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-af942401-4c2d-4c2e-8f9f-c063e6ac0530 tempest-VolumeDependencyTests-308026860 None] Create snapshot completed successfully Jul 29 16:23:25 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7c1ba994-bd27-41c1-92ad-700d54278bda tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-2239ef80-30cd-469a-ad02-e6b8a6f7875f-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:25 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc Jul 29 16:23:25 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:25 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Deleted volume successfully. Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-91733d2f-1972-4138-a6e2-0a76f6022f86 tempest-CreateVolumesFromImageTest-666581070 None] Lock "cinder-fa7be984-b380-4f97-b2d9-630a405137cf-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:25 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc" returned: 0 in 0.627s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:25 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc Jul 29 16:23:25 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:25 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 1073741824" returned: 0 in 0.621s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:25 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 Jul 29 16:23:25 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:26 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc" released by "delete_volume" :: held 1.073s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created reservations ['a849d8c6-f5d0-407f-9640-23a99d15f917', '243108f4-d963-4682-a4c8-bc03756020c0', '1315cdb2-b8cb-4a44-85f2-54e5385c5989', '8c6062ff-672f-4662-845b-7f3a17eb3ae4'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:26 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Flow 'volume_create_manager' (a990893d-3a1a-44fe-9f38-c4a5566c317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ffb10e-dbe0-4e86-9d4e-836e0a996e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Attempting download of f64959b2-ca9c-4b65-a242-a60b75db5f87 ((None, [{'url': 'file:///opt/stack/data/glance/images/f64959b2-ca9c-4b65-a242-a60b75db5f87', 'metadata': {}}])) to volume 67811882-1ddf-4a84-b720-13d194804c85. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ffb10e-dbe0-4e86-9d4e-836e0a996e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224511146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a32c78-d27f-4939-b720-a2cd7c9009b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3f08bda503439c935a3fcfc3639f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=797df377-b729-4d25-90b4-b10fe8343cdc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:26Z,use_quota=True,user_id='3c2fa325fe994aec9209f003a3b0f253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e57a509-0dcc-4f03-b4b9-53f352d69ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e57a509-0dcc-4f03-b4b9-53f352d69ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e1dcb1-de9c-404f-a272-fc3c4a02a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e1dcb1-de9c-404f-a272-fc3c4a02a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31a32c78-d27f-4939-b720-a2cd7c9009b2', 'volume_name': 'volume-31a32c78-d27f-4939-b720-a2cd7c9009b2', 'volume_size': 1, 'snapshot_id': '797df377-b729-4d25-90b4-b10fe8343cdc'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3721b6fe-3766-4373-b7e5-247b46f43ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3721b6fe-3766-4373-b7e5-247b46f43ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2faf40a-811c-4730-8a98-3b0d95309d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Volume 31a32c78-d27f-4939-b720-a2cd7c9009b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31a32c78-d27f-4939-b720-a2cd7c9009b2', 'volume_size': 1, 'snapshot_id': '797df377-b729-4d25-90b4-b10fe8343cdc'} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-quobyte-797df377-b729-4d25-90b4-b10fe8343cdc-31a32c78-d27f-4939-b720-a2cd7c9009b2" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[64014480-d8a3-44cf-b19c-aef90de7c078]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-797df377-b729-4d25-90b4-b10fe8343cdc-31a32c78-d27f-4939-b720-a2cd7c9009b2" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Creating volume 31a32c78-d27f-4939-b720-a2cd7c9009b2 from snapshot 797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-quobyte-31a32c78-d27f-4939-b720-a2cd7c9009b2" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:26 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:26 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-31a32c78-d27f-4939-b720-a2cd7c9009b2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] snapshot: 797df377-b729-4d25-90b4-b10fe8343cdc, volume: 31a32c78-d27f-4939-b720-a2cd7c9009b2, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:23:26 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji Jul 29 16:23:26 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605eadd-dc47-4c76-a219-51b6349e66a0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:26 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc Jul 29 16:23:26 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:26 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Deleted volume successfully. Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-468d6c39-a92a-4c51-9b5a-dc1cb8cd15fb tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-19c199ae-5ab7-4ffd-9770-ceaad13c8bcc-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:26 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji" returned: 0 in 0.446s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:26 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji Jul 29 16:23:26 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:27 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc" returned: 0 in 0.505s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fabfb58-91b1-498f-aa01-1b411970bc44]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-3b66bb67-8d86-494b-ac0b-8764372a0033-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-3b66bb67-8d86-494b-ac0b-8764372a0033-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-quobyte-3b66bb67-8d86-494b-ac0b-8764372a0033" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-3b66bb67-8d86-494b-ac0b-8764372a0033" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:27 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:27 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:27 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji" returned: 1 in 0.474s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f64959b2-ca9c-4b65-a242-a60b75db5f87_wj93o9ji' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f14ee34-0a58-400b-916c-4bcf721d5a5b]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe791370-bb25-4425-b407-c1689a10431b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:27 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD Jul 29 16:23:27 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:27 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 Jul 29 16:23:27 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:27 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.510s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:27 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 Jul 29 16:23:27 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:27 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:27 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033" returned: 0 in 0.484s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:27 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD Jul 29 16:23:27 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:27 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033 Jul 29 16:23:27 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:28 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] f64959b2-ca9c-4b65-a242-a60b75db5f87 was raw, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:23:28 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-3b66bb67-8d86-494b-ac0b-8764372a0033" returned: 0 in 0.356s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-3b66bb67-8d86-494b-ac0b-8764372a0033" released by "delete_volume" :: held 0.934s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:28 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 Jul 29 16:23:28 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created reservations ['63844021-0eeb-41c7-b59f-db30e81d2284', '4bd6a664-4895-4fe1-a5b4-25c8a7b2e4e1', 'a4b47bbf-ffbb-4e1b-af26-fc9926356c8c', '6906f87a-dc0e-4244-be31-3c6c327c6476'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:28 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:28 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:29 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.783s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:29 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Deleted volume successfully. Jul 29 16:23:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-053c9d22-4245-4f01-908f-f33150dffbe1 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-3b66bb67-8d86-494b-ac0b-8764372a0033-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:29 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85" returned: 0 in 1.549s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:29 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f64959b2-ca9c-4b65-a242-a60b75db5f87_1iwj49_jdevstack@QuobyteHD, size 0.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:23:29 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Converted 0.00 MB image at 0.00 MB/s Jul 29 16:23:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:29 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 1G Jul 29 16:23:29 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-7603387e-2629-4b43-b0fa-25de7b781f4e-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-7603387e-2629-4b43-b0fa-25de7b781f4e-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-quobyte-7603387e-2629-4b43-b0fa-25de7b781f4e" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-7603387e-2629-4b43-b0fa-25de7b781f4e" acquired by "delete_volume" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d01263-12e8-4392-933d-d66495ace806]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:30 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e Jul 29 16:23:30 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:30 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 1G" returned: 0 in 1.104s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Downloaded image f64959b2-ca9c-4b65-a242-a60b75db5f87 ((None, [{'url': 'file:///opt/stack/data/glance/images/f64959b2-ca9c-4b65-a242-a60b75db5f87', 'metadata': {}}])) to volume 67811882-1ddf-4a84-b720-13d194804c85 successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Temporary image f64959b2-ca9c-4b65-a242-a60b75db5f87 for user 5924bf596e3a4099b917943cfd6a8913 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Marking volume 67811882-1ddf-4a84-b720-13d194804c85 as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Copying metadata from image f64959b2-ca9c-4b65-a242-a60b75db5f87 to 67811882-1ddf-4a84-b720-13d194804c85. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:23:30 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Creating volume glance metadata for volume 67811882-1ddf-4a84-b720-13d194804c85 backed by image f64959b2-ca9c-4b65-a242-a60b75db5f87 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '93bf16846c3ef8ad27566095185eca04', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07653f63-9f8a-4755-a64c-527aaca56ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67811882-1ddf-4a84-b720-13d194804c85', 'volume_size': 1, 'image_id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f64959b2-ca9c-4b65-a242-a60b75db5f87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93bf16846c3ef8ad27566095185eca04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b09b8973d6b94fd3bfa7a45f04fb5c72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6683082ee73d05351d4f3f4ec95d4e1fcd80f6769e9b2ec2ccaf35f8e9f15c22f34d3c12963555ba6e0e78f82bbd38b95770563e57099b3d420f9333ebe7a7ec', 'id': 'f64959b2-ca9c-4b65-a242-a60b75db5f87', 'created_at': datetime.datetime(2026, 7, 29, 14, 23, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 23, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f64959b2-ca9c-4b65-a242-a60b75db5f87/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dd1430-3ee5-409f-8300-8f7b84ff3e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:31 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Volume volume-67811882-1ddf-4a84-b720-13d194804c85 (67811882-1ddf-4a84-b720-13d194804c85): created successfully Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dd1430-3ee5-409f-8300-8f7b84ff3e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Flow 'volume_create_manager' (166ecf44-0806-4921-b5d3-481366740744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4abd75d7-34fb-45d6-a19b-b0142281a8f8 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Created volume successfully. Jul 29 16:23:31 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e" returned: 0 in 0.777s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:31 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e Jul 29 16:23:31 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:31 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7603387e-2629-4b43-b0fa-25de7b781f4e" returned: 0 in 0.560s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-7603387e-2629-4b43-b0fa-25de7b781f4e" released by "delete_volume" :: held 1.475s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created reservations ['dea8f51b-38c1-4320-9ef3-b7ff81a62da0', 'c61ba087-a987-4b4f-9818-ceef0b2b9615', '6a7d395d-52c4-4582-be02-45c82a342f94', '6eba42d8-b361-4e9a-98e5-881bc841d17b'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:32 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:32 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Acquiring lock "cinder-67811882-1ddf-4a84-b720-13d194804c85-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "cinder-67811882-1ddf-4a84-b720-13d194804c85-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Acquiring lock "cinder-quobyte-67811882-1ddf-4a84-b720-13d194804c85" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "cinder-quobyte-67811882-1ddf-4a84-b720-13d194804c85" acquired by "delete_volume" :: waited 0.060s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60da620-3e1e-4d82-8dce-8434bbc1d1c9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-24620519-b168-49ef-bd7d-e4f3ac8ca8b2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-24620519-b168-49ef-bd7d-e4f3ac8ca8b2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:32 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.636s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:32 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:32 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Deleted volume successfully. Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f47b61a2-fa91-4c9a-a985-756a57274aac tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-7603387e-2629-4b43-b0fa-25de7b781f4e-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-quobyte-24620519-b168-49ef-bd7d-e4f3ac8ca8b2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-24620519-b168-49ef-bd7d-e4f3ac8ca8b2" acquired by "delete_volume" :: waited 0.048s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:33 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 Jul 29 16:23:33 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1870b07-6e14-4d73-bfc9-5035535876bf]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:33 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 Jul 29 16:23:33 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:33 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:33 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85" returned: 0 in 1.206s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2" returned: 0 in 0.775s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:33 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85 Jul 29 16:23:33 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:33 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2 Jul 29 16:23:33 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:34 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2" returned: 0 in 6.434s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8e9bb-720c-4c41-8ba1-f74be4cafeea]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:34 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:34 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:34 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-67811882-1ddf-4a84-b720-13d194804c85" returned: 0 in 0.312s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:34 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "cinder-quobyte-67811882-1ddf-4a84-b720-13d194804c85" released by "delete_volume" :: held 1.631s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-24620519-b168-49ef-bd7d-e4f3ac8ca8b2" returned: 0 in 0.326s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-24620519-b168-49ef-bd7d-e4f3ac8ca8b2" released by "delete_volume" :: held 1.199s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Created reservations ['2d228f7f-2b3b-482b-9354-28b53af138a6', '12db8e95-af8c-4fbe-8a90-1df078488ff6', '8a040e95-5d00-4c2a-9661-ef2148a70b84', '5ff78efe-e5ad-41e1-9797-79c413d48c69'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created reservations ['969ef92f-5192-4105-a45b-80e075b47796', '04ac5731-acee-4855-a6e6-5cfeb27af671', 'efb31923-4d80-4620-9495-70e8ce62e494', 'dc464fd2-a856-4ca1-94fb-f9344fd3f133'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:34 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:34 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:34 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:34 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:34 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.763s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:23:34 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Converted 1024.00 MB image at 159.13 MB/s Jul 29 16:23:34 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 is being set with open permissions: ugo+rw Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:34 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 Jul 29 16:23:34 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:34 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.366s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:34 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Deleted volume successfully. Jul 29 16:23:34 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a3dcfc6-6d7d-40db-b673-bfa237b144b4 tempest-VolumeAndVolumeTypeFromImageTest-77205770 None] Lock "cinder-67811882-1ddf-4a84-b720-13d194804c85-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:35 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.431s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Deleted volume successfully. Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-1f25d21b-a639-417c-ab99-3f5a864778f5 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-24620519-b168-49ef-bd7d-e4f3ac8ca8b2-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:35 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-31a32c78-d27f-4939-b720-a2cd7c9009b2" released by "_copy_volume_from_snapshot" :: held 8.830s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-797df377-b729-4d25-90b4-b10fe8343cdc-31a32c78-d27f-4939-b720-a2cd7c9009b2" released by "_create_volume_from_snapshot" :: held 8.890s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.943s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "cinder-quobyte-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2faf40a-811c-4730-8a98-3b0d95309d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a32c78-d27f-4939-b720-a2cd7c9009b2', 'volume_size': 1, 'snapshot_id': '797df377-b729-4d25-90b4-b10fe8343cdc'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0682fbef-3750-411d-9d33-80e82d669647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e" acquired by "delete_volume" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:35 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Volume volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 (31a32c78-d27f-4939-b720-a2cd7c9009b2): created successfully Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0682fbef-3750-411d-9d33-80e82d669647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Flow 'volume_create_manager' (a990893d-3a1a-44fe-9f38-c4a5566c317b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a756289-a43f-4862-946f-c1d8bc15b058]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d36bdfa4-c6cd-4470-8b5a-42a9e43d09cd tempest-VolumeDependencyTests-308026860 None] Created volume successfully. Jul 29 16:23:35 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e Jul 29 16:23:35 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:35 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e" returned: 0 in 0.442s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:35 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e Jul 29 16:23:35 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:36 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e" returned: 0 in 0.349s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-quobyte-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e" released by "delete_volume" :: held 0.861s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Created reservations ['e2679103-7c6c-4c6e-bece-7d54e1832336', '3cffd350-dc31-4be9-bd40-2eb628051d7f', '89066aae-6aa1-49da-a523-39ea460adecb', 'a1a62ef3-8ac5-4c85-8884-2bef7dded161'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-797df377-b729-4d25-90b4-b10fe8343cdc-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Lock "cinder-797df377-b729-4d25-90b4-b10fe8343cdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-quobyte-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:36 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-quobyte-797df377-b729-4d25-90b4-b10fe8343cdc" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:36 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-797df377-b729-4d25-90b4-b10fe8343cdc" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Deleting offline snapshot 797df377-b729-4d25-90b4-b10fe8343cdc of volume 2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] snapshot_file for this snap is: volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece80d3-c815-41ee-83e8-82f6411d4ee3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:36 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:36 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:36 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc Jul 29 16:23:36 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:36 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.417s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Deleted volume successfully. Jul 29 16:23:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-c687eb27-3a57-42c7-94ef-f843e04916b3 tempest-CreateVolumesFromSourceVolumeTest-1743784549 None] Lock "cinder-9430bcaf-c46e-4a7e-bc79-ba63bd51c37e-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:37 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.418s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:37 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc" returned: 0 in 0.604s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eeb8c1-d2a1-43f5-b72a-538b6ecdde9b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:37 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:37 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:37 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.503s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:37 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc Jul 29 16:23:37 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:38 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc" returned: 0 in 0.485s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:38 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc Jul 29 16:23:38 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:38 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f.797df377-b729-4d25-90b4-b10fe8343cdc" returned: 0 in 0.311s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-797df377-b729-4d25-90b4-b10fe8343cdc" released by "_delete_snapshot" :: held 2.088s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" released by "delete_snapshot" :: held 2.139s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Created reservations ['c471befc-747a-468d-b6d3-12d70fd3cc7f', 'ab47a80f-595a-4009-9538-005a1135b654', '7cf63fcc-2afb-40c9-8a3e-346212e5d5bf', '8199bffe-cdce-4466-b083-e1755f0694c5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Delete snapshot completed successfully. Jul 29 16:23:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457cdda4-5916-45f7-8ca2-19579430abaf tempest-VolumeDependencyTests-308026860 None] Lock "cinder-797df377-b729-4d25-90b4-b10fe8343cdc-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-quobyte-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be4af2-55d2-4a86-9c0b-980ae678f944]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:40 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:40 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:40 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.606s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:40 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f Jul 29 16:23:40 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:40 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" returned: 0 in 0.373s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f" released by "delete_volume" :: held 1.101s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Created reservations ['9446b652-9890-4577-a1ed-55facb6fcfd9', '21791bb5-08e7-4a58-8979-71be7298111e', '1d9edacc-0ed7-4913-b1bf-2399a1403fba', '7db5df24-ef62-4d89-b7d8-e90cc832b21c'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:41 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:41 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:41 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.321s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Deleted volume successfully. Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4dc37ba2-9d2a-49f3-96ce-47b0ffe5ada1 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-2f08e887-c3fe-4d08-a6fd-b7a7be919f7f-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (2931ccbd-ce59-45ee-b1d1-78c58ea8edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4838fb37-1bec-4193-a80e-c85bf95b3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4838fb37-1bec-4193-a80e-c85bf95b3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1709340222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae8aa90-a1d2-484f-bf69-16e713900fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:42Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08894c35-b4dd-4f21-82dc-f1bd6785d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08894c35-b4dd-4f21-82dc-f1bd6785d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf16b7d-8504-4940-ac81-761b40a812a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf16b7d-8504-4940-ac81-761b40a812a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae8aa90-a1d2-484f-bf69-16e713900fcb', 'volume_name': 'volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994c32e9-b009-4bc5-8bfc-9f3139e6ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994c32e9-b009-4bc5-8bfc-9f3139e6ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ca6e97-4b9f-4754-b4f8-a433135763b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:41 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume 2ae8aa90-a1d2-484f-bf69-16e713900fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb', 'volume_size': 1} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1709340222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae8aa90-a1d2-484f-bf69-16e713900fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:42Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating volume 2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:41 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:42 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb 1073741824 Jul 29 16:23:42 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-31a32c78-d27f-4939-b720-a2cd7c9009b2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-31a32c78-d27f-4939-b720-a2cd7c9009b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "cinder-quobyte-31a32c78-d27f-4939-b720-a2cd7c9009b2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-31a32c78-d27f-4939-b720-a2cd7c9009b2" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0cc7ef-8bae-4be4-b46b-a0ba29b74377]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:42 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 Jul 29 16:23:42 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5932661d-7472-4a70-9ed2-240a9d8182cb tempest-ProjectAdminTests-1422589552 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7427024841309, 'free_capacity_gb': 1775.7427024841309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88575) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 29 16:23:42 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb 1073741824" returned: 0 in 0.656s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:42 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb Jul 29 16:23:42 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:42 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2" returned: 0 in 0.530s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:42 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2 Jul 29 16:23:42 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:43 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb" returned: 0 in 0.349s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ca6e97-4b9f-4754-b4f8-a433135763b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a735898-f5aa-4d1d-a703-a1a85fffeee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:43 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb (2ae8aa90-a1d2-484f-bf69-16e713900fcb): created successfully Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a735898-f5aa-4d1d-a703-a1a85fffeee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (2931ccbd-ce59-45ee-b1d1-78c58ea8edca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-d059453c-9edd-4ee3-898a-9fea1b16c8c1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created volume successfully. Jul 29 16:23:43 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-31a32c78-d27f-4939-b720-a2cd7c9009b2" returned: 0 in 0.375s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-quobyte-31a32c78-d27f-4939-b720-a2cd7c9009b2" released by "delete_volume" :: held 0.981s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Created reservations ['fffae1f3-5c66-46f3-a34e-989ca90c9fbc', '1c867cd0-5258-4262-b53a-2e22acbf7e30', 'a9349d54-2de0-4863-bfc2-7ddf3750bc23', '3740739e-467f-4ed7-b32c-fb308578f85f'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:43 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:43 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:43 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.339s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Deleted volume successfully. Jul 29 16:23:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-457e4b92-b60f-4eb0-b080-63d88d606f12 tempest-VolumeDependencyTests-308026860 None] Lock "cinder-31a32c78-d27f-4939-b720-a2cd7c9009b2-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating offline snapshot b80d6533-c93c-4b1d-9922-82f9b53795c1 of volume 2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f95923-d8f5-41fd-9b49-be2af405d853]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:44 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb Jul 29 16:23:44 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:44 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb" returned: 0 in 0.464s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:44 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 1G Jul 29 16:23:44 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:45 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 1G" returned: 0 in 0.566s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:45 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 Jul 29 16:23:45 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:45 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1" returned: 0 in 0.444s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:45 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 is being set with open permissions: ugo+rw Jul 29 16:23:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:45 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 Jul 29 16:23:45 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:46 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1" returned: 0 in 0.338s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:46 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info Jul 29 16:23:46 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:46 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info" returned: 0 in 0.462s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:46 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info is being set with open permissions: ugo+rw Jul 29 16:23:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:46 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info Jul 29 16:23:46 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:46 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.info" returned: 0 in 0.316s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ed21e9ee-7fff-4d60-bedd-5284d6e633b1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Create snapshot completed successfully Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (3097ce48-6d91-4e6e-847d-1e969d7073ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02826df7-e568-49dc-b4a6-fd33e8a4ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02826df7-e568-49dc-b4a6-fd33e8a4ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-426110061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571222bb-220f-4612-af37-94af730e893c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:48Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e285f1bd-5ac3-4a18-856a-3d5a03bb7bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e285f1bd-5ac3-4a18-856a-3d5a03bb7bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1523eca-54ef-4133-bc67-eec95c6b1ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1523eca-54ef-4133-bc67-eec95c6b1ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571222bb-220f-4612-af37-94af730e893c', 'volume_name': 'volume-571222bb-220f-4612-af37-94af730e893c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5edcdba-fb4f-45b2-a63a-6a99e4490c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5edcdba-fb4f-45b2-a63a-6a99e4490c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9a8f33-b8df-4017-941b-b8e4f7c01ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume 571222bb-220f-4612-af37-94af730e893c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571222bb-220f-4612-af37-94af730e893c', 'volume_size': 1} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-426110061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571222bb-220f-4612-af37-94af730e893c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:48Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating volume 571222bb-220f-4612-af37-94af730e893c {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:48 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:48 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c 1073741824 Jul 29 16:23:48 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (7ee63aea-9b12-4c92-9691-d57402f9bcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2909f898-ed73-47ec-85ac-80b772a3be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2909f898-ed73-47ec-85ac-80b772a3be08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317818797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0bca6d-dc10-4140-b484-d29e23c4cab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:49Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322f2255-5f46-49d7-aa07-3880d3b0248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322f2255-5f46-49d7-aa07-3880d3b0248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c6ea32-677f-4c8f-a14b-13aa6f72234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c6ea32-677f-4c8f-a14b-13aa6f72234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0bca6d-dc10-4140-b484-d29e23c4cab8', 'volume_name': 'volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5662875-4806-4eb2-b929-85f622727edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5662875-4806-4eb2-b929-85f622727edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5dad24-f968-46df-ba40-ef1be913d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Volume 8a0bca6d-dc10-4140-b484-d29e23c4cab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8', 'volume_size': 1} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (ed50d1d7-d450-47fd-b879-d44d39cde571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8643a2ce-a505-448a-9ce1-46ed9a4d3a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8643a2ce-a505-448a-9ce1-46ed9a4d3a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912393449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb51c5b0-30b0-4c9d-b6cc-783c9b70f905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:49Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb152d9d-88f5-4d50-9217-0f9cb4f6b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb152d9d-88f5-4d50-9217-0f9cb4f6b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffe8d77-038e-42f5-9418-d0605786b487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffe8d77-038e-42f5-9418-d0605786b487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb51c5b0-30b0-4c9d-b6cc-783c9b70f905', 'volume_name': 'volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094a44ce-ec5c-4ab0-a9de-1bbe5368df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094a44ce-ec5c-4ab0-a9de-1bbe5368df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b5e3c4-f1a7-41ca-9ca7-3d322511f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume cb51c5b0-30b0-4c9d-b6cc-783c9b70f905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905', 'volume_size': 1} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:49 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c 1073741824" returned: 0 in 0.773s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:49 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c Jul 29 16:23:49 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (73df6288-9890-4aa3-89ca-32bb82f64a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848155ac-a2d8-4dcd-8541-2a402f252dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848155ac-a2d8-4dcd-8541-2a402f252dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844349659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b41c47-4237-4dc4-bd7d-f76bd531af89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:49Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bb97f4-fef7-4b49-8473-5786ffb2cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bb97f4-fef7-4b49-8473-5786ffb2cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cecc9c-97d4-4986-8e94-50c191b0d5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cecc9c-97d4-4986-8e94-50c191b0d5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b41c47-4237-4dc4-bd7d-f76bd531af89', 'volume_name': 'volume-03b41c47-4237-4dc4-bd7d-f76bd531af89', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6f77af-3d98-4b27-bae8-6d9e76d0aaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6f77af-3d98-4b27-bae8-6d9e76d0aaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f43d216-70fa-4506-9893-a2371f81345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume 03b41c47-4237-4dc4-bd7d-f76bd531af89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b41c47-4237-4dc4-bd7d-f76bd531af89', 'volume_size': 1} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:49 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c" returned: 0 in 0.349s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317818797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0bca6d-dc10-4140-b484-d29e23c4cab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:49Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Creating volume 8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:49 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9a8f33-b8df-4017-941b-b8e4f7c01ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571222bb-220f-4612-af37-94af730e893c', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 1073741824 Jul 29 16:23:49 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2900195-1371-4ea9-a27f-96607fb0b0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:49 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume volume-571222bb-220f-4612-af37-94af730e893c (571222bb-220f-4612-af37-94af730e893c): created successfully Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2900195-1371-4ea9-a27f-96607fb0b0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:49 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (3097ce48-6d91-4e6e-847d-1e969d7073ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2cf88256-c5c9-4090-a7f1-b6fb6bd1ac48 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created volume successfully. Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (973a921a-aa28-4b08-858a-906ac70963e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7281a91-ae04-4dea-903e-1d841d215cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7281a91-ae04-4dea-903e-1d841d215cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-418476900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc690bfa-9fcc-4c88-8494-e67cd24dfd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:50Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87145800-f724-42f3-8e50-49c5dc6eb952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87145800-f724-42f3-8e50-49c5dc6eb952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d80f9b-3d48-4285-a375-d18ef0b3cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d80f9b-3d48-4285-a375-d18ef0b3cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc690bfa-9fcc-4c88-8494-e67cd24dfd04', 'volume_name': 'volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4364dfff-5308-4390-b5ef-a9970676c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4364dfff-5308-4390-b5ef-a9970676c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93861f7-1ee0-4fc3-a45d-0ed82a7d2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume dc690bfa-9fcc-4c88-8494-e67cd24dfd04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04', 'volume_size': 1} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:50 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 1073741824" returned: 0 in 0.735s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:50 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 Jul 29 16:23:50 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (e85465d5-7644-4fc6-a7e7-74c6f83f03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730474a7-12f9-4265-8522-cb6ab2800044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730474a7-12f9-4265-8522-cb6ab2800044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1858974998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a2b63f-7c5f-4348-8555-26e4f134ec08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:51Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae05ff46-cafa-475f-860a-7c3982af9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae05ff46-cafa-475f-860a-7c3982af9149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70daa21-a76f-4cdf-bdab-ccf0c2880b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70daa21-a76f-4cdf-bdab-ccf0c2880b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a2b63f-7c5f-4348-8555-26e4f134ec08', 'volume_name': 'volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c85b50-8120-43a8-8a9f-0dde75c6aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c85b50-8120-43a8-8a9f-0dde75c6aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800de306-3c03-4fc7-ad61-40f854731d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume b4a2b63f-7c5f-4348-8555-26e4f134ec08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08', 'volume_size': 1} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:50 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8" returned: 0 in 0.392s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912393449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb51c5b0-30b0-4c9d-b6cc-783c9b70f905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:49Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating volume cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:50 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5dad24-f968-46df-ba40-ef1be913d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7d960a-0aa0-4a00-991b-e7fb2f6e15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:50 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 1073741824 Jul 29 16:23:50 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:50 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Volume volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 (8a0bca6d-dc10-4140-b484-d29e23c4cab8): created successfully Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7d960a-0aa0-4a00-991b-e7fb2f6e15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:50 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (7ee63aea-9b12-4c92-9691-d57402f9bcc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b36bc9e5-29ac-457e-bd47-f727c973e498 tempest-ProjectReaderTests-504587999 None] Created volume successfully. Jul 29 16:23:51 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 1073741824" returned: 0 in 0.769s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:51 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 Jul 29 16:23:51 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:52 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905" returned: 0 in 0.308s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.473s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844349659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b41c47-4237-4dc4-bd7d-f76bd531af89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:49Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating volume 03b41c47-4237-4dc4-bd7d-f76bd531af89 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:52 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b5e3c4-f1a7-41ca-9ca7-3d322511f376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:52 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 1073741824 Jul 29 16:23:52 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31d69b8-dde7-4532-b721-f3967c006529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:52 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 (cb51c5b0-30b0-4c9d-b6cc-783c9b70f905): created successfully Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31d69b8-dde7-4532-b721-f3967c006529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (ed50d1d7-d450-47fd-b879-d44d39cde571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-271c38d2-ef0b-46c8-90e0-e9c380438356 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created volume successfully. Jul 29 16:23:52 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 1073741824" returned: 0 in 0.802s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:52 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 Jul 29 16:23:52 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Flow 'volume_create_manager' (d91467ca-fb1a-4da7-abec-f5214f182ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83f9d7e-ec37-4eb8-ae54-d1fb34018819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83f9d7e-ec37-4eb8-ae54-d1fb34018819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff06b3c-bf9a-47f7-bb36-cf1a407c7211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2c48de4666435984adbda68e143ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:53Z,use_quota=True,user_id='1dd00a895b73448290857e00ccb60459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacad406-aa24-461d-8e23-3255de941eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacad406-aa24-461d-8e23-3255de941eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2a7f87-d0de-4238-a32b-5708f42ab185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.image.glance [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Creating Keystone auth plugin from conf {{(pid=88575) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 29 16:23:53 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.078s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-418476900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc690bfa-9fcc-4c88-8494-e67cd24dfd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:50Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating volume dc690bfa-9fcc-4c88-8494-e67cd24dfd04 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:53 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:53 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 1073741824 Jul 29 16:23:53 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f43d216-70fa-4506-9893-a2371f81345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b41c47-4237-4dc4-bd7d-f76bd531af89', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177903ee-c149-4f9a-bd1f-4a732eb51da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:53 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 (03b41c47-4237-4dc4-bd7d-f76bd531af89): created successfully Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177903ee-c149-4f9a-bd1f-4a732eb51da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (73df6288-9890-4aa3-89ca-32bb82f64a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:53 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-1c0592d0-f6c2-4b3e-a667-dd798ae10aa4 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created volume successfully. Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2a7f87-d0de-4238-a32b-5708f42ab185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eff06b3c-bf9a-47f7-bb36-cf1a407c7211', 'volume_name': 'volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211', 'volume_size': 1, 'image_id': 'd7eaee99-1769-4116-b056-708685019abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7eaee99-1769-4116-b056-708685019abc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f19290e359286a333975f12422175118', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b2c48de4666435984adbda68e143ac4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '089225728e42b8da23348a87b494c3a5d15963f83ca3d643d64c1ad5c641258ebe8b9797be4f118b619f34a918328a0763ca14b2fe46439811d4e0da28743297', 'id': 'd7eaee99-1769-4116-b056-708685019abc', 'created_at': datetime.datetime(2026, 7, 29, 14, 23, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 23, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7eaee99-1769-4116-b056-708685019abc/file', 'properties': {}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02320e44-f859-430e-9cd1-f90311ec5372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02320e44-f859-430e-9cd1-f90311ec5372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c350aa90-4b8a-43eb-b13f-6cbdbf84b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:53 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Volume eff06b3c-bf9a-47f7-bb36-cf1a407c7211: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211', 'volume_size': 1, 'image_id': 'd7eaee99-1769-4116-b056-708685019abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7eaee99-1769-4116-b056-708685019abc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f19290e359286a333975f12422175118', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b2c48de4666435984adbda68e143ac4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '089225728e42b8da23348a87b494c3a5d15963f83ca3d643d64c1ad5c641258ebe8b9797be4f118b619f34a918328a0763ca14b2fe46439811d4e0da28743297', 'id': 'd7eaee99-1769-4116-b056-708685019abc', 'created_at': datetime.datetime(2026, 7, 29, 14, 23, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 23, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7eaee99-1769-4116-b056-708685019abc/file', 'properties': {}}, 'image_service': } Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Trying to clone eff06b3c-bf9a-47f7-bb36-cf1a407c7211 from image d7eaee99-1769-4116-b056-708685019abc at location (None, [{'url': 'file:///opt/stack/data/glance/images/d7eaee99-1769-4116-b056-708685019abc', 'metadata': {}}]). {{(pid=88575) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 29 16:23:53 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Image download 0.00 MB at 0.00 MB/s Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa38fcb-b3e2-49da-b84f-a33a185220f4]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:53 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 1073741824" returned: 0 in 0.526s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:53 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD Jul 29 16:23:53 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:53 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 Jul 29 16:23:53 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:54 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:54 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04" returned: 0 in 0.369s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.483s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1858974998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a2b63f-7c5f-4348-8555-26e4f134ec08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e7b220d8444cca94bfbcb09ca67614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:51Z,use_quota=True,user_id='4a125b9bc3624588b3d07c3322a6d4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Creating volume b4a2b63f-7c5f-4348-8555-26e4f134ec08 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:54 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93861f7-1ee0-4fc3-a45d-0ed82a7d2766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74659137-ef76-4efe-97a4-cdf5bf3a910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:54 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD Jul 29 16:23:54 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:54 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 1073741824 Jul 29 16:23:54 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 (dc690bfa-9fcc-4c88-8494-e67cd24dfd04): created successfully Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74659137-ef76-4efe-97a4-cdf5bf3a910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (973a921a-aa28-4b08-858a-906ac70963e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3e09586a-7044-4fb0-8707-edf19f042659 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created volume successfully. Jul 29 16:23:54 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Temporary image d7eaee99-1769-4116-b056-708685019abc is fetched for user 1dd00a895b73448290857e00ccb60459. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5724a-a995-43b8-84e2-2fa3536f76b4]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:54 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD Jul 29 16:23:54 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:54 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 1073741824" returned: 0 in 0.552s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:54 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 Jul 29 16:23:54 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:54 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:55 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD Jul 29 16:23:55 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:55 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08" returned: 0 in 0.396s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.336s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800de306-3c03-4fc7-ad61-40f854731d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97340a4f-a866-4b65-a397-37ae62b21938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Creating offline snapshot 3a9ffdcb-86b0-479f-8799-93e79e328eba of volume 8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:23:55 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Volume volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 (b4a2b63f-7c5f-4348-8555-26e4f134ec08): created successfully Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97340a4f-a866-4b65-a397-37ae62b21938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Flow 'volume_create_manager' (e85465d5-7644-4fc6-a7e7-74c6f83f03f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a5bac-57f6-40e1-8d08-1145d53612e7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:55 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fb7754c2-ada8-4dd7-badb-ea53783e8bc1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created volume successfully. Jul 29 16:23:55 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 Jul 29 16:23:55 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:55 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD" returned: 1 in 0.683s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:55 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8" returned: 0 in 0.514s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:55 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba 1G Jul 29 16:23:55 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:56 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba 1G" returned: 0 in 0.508s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:56 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba Jul 29 16:23:56 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-b4a2b63f-7c5f-4348-8555-26e4f134ec08-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-b4a2b63f-7c5f-4348-8555-26e4f134ec08-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-b4a2b63f-7c5f-4348-8555-26e4f134ec08" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-b4a2b63f-7c5f-4348-8555-26e4f134ec08" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfaec9a-b651-4bb8-ba39-cb4247dc6aff]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:56 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 Jul 29 16:23:56 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:56 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba" returned: 0 in 0.418s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:56 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba is being set with open permissions: ugo+rw Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:56 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba Jul 29 16:23:56 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:56 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08" returned: 0 in 0.427s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:56 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08 Jul 29 16:23:56 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:57 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba" returned: 0 in 0.294s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:57 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info Jul 29 16:23:57 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:57 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-b4a2b63f-7c5f-4348-8555-26e4f134ec08" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-b4a2b63f-7c5f-4348-8555-26e4f134ec08" released by "delete_volume" :: held 0.801s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['43f733cc-8181-491c-854c-8ed6af412d59', '4c28d83d-9711-4a4c-a302-4bc3a18a7fde', '84f66c2b-246c-404d-8009-c7d060aff954', '7ecdb75d-2639-43b3-8992-4ee334f60e7d'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:57 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:57 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info is being set with open permissions: ugo+rw Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:57 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:57 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:57 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info Jul 29 16:23:57 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-dc690bfa-9fcc-4c88-8494-e67cd24dfd04-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-dc690bfa-9fcc-4c88-8494-e67cd24dfd04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-dc690bfa-9fcc-4c88-8494-e67cd24dfd04" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:57 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.info" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:57 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-dc690bfa-9fcc-4c88-8494-e67cd24dfd04" acquired by "delete_volume" :: waited 0.062s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff06b3c-bf9a-47f7-bb36-cf1a407c7211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2c48de4666435984adbda68e143ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:23:53Z,use_quota=True,user_id='1dd00a895b73448290857e00ccb60459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Creating volume eff06b3c-bf9a-47f7-bb36-cf1a407c7211 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:23:57 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7bbd9-c385-4f9e-978c-835181adc79d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:57 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 1073741824 Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.477s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:57 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:57 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleted volume successfully. Jul 29 16:23:57 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-175f80b8-9a89-4837-8674-184645f6a507 tempest-ProjectReaderTests-504587999 None] Create snapshot completed successfully Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-41934513-8dbf-412a-9ec1-6b83e869830a tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-b4a2b63f-7c5f-4348-8555-26e4f134ec08-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:58 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 Jul 29 16:23:58 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:58 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04" returned: 0 in 0.580s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:58 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04 Jul 29 16:23:58 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-3a9ffdcb-86b0-479f-8799-93e79e328eba-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Lock "cinder-3a9ffdcb-86b0-479f-8799-93e79e328eba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-8a0bca6d-dc10-4140-b484-d29e23c4cab8" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-8a0bca6d-dc10-4140-b484-d29e23c4cab8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-3a9ffdcb-86b0-479f-8799-93e79e328eba" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-3a9ffdcb-86b0-479f-8799-93e79e328eba" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Deleting offline snapshot 3a9ffdcb-86b0-479f-8799-93e79e328eba of volume 8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:23:58 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] snapshot_file for this snap is: volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 1073741824" returned: 0 in 0.792s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8eafd4-082e-4ebc-adaa-214b555d077b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:58 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 Jul 29 16:23:58 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:58 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba Jul 29 16:23:58 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:59 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-dc690bfa-9fcc-4c88-8494-e67cd24dfd04" returned: 0 in 0.536s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-dc690bfa-9fcc-4c88-8494-e67cd24dfd04" released by "delete_volume" :: held 1.189s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['ee36d549-f92d-4e6d-82d7-820118a19e92', 'b0e2d6ae-4c31-4459-b554-ac9f4ac9263b', '27a85654-7172-406e-870a-885ca738ebc0', 'c4f7d486-e56b-4f13-b06e-6c08e1e8b659'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:59 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" returned: 0 in 0.522s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:23:59 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:23:59 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Attempting download of d7eaee99-1769-4116-b056-708685019abc ((None, [{'url': 'file:///opt/stack/data/glance/images/d7eaee99-1769-4116-b056-708685019abc', 'metadata': {}}])) to volume eff06b3c-bf9a-47f7-bb36-cf1a407c7211. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 29 16:23:59 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba" returned: 0 in 0.639s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a7352-e8f9-471a-9a4a-565eb1a231e9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ac45f-e300-4519-82f6-9aafaae596d3]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:59 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 Jul 29 16:23:59 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:59 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l Jul 29 16:23:59 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:59 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.311s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:23:59 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleted volume successfully. Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-33a6b375-aca3-478e-b0c3-aaf3d6cc7800 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-dc690bfa-9fcc-4c88-8494-e67cd24dfd04-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:23:59 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l" returned: 0 in 0.403s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:59 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8" returned: 0 in 0.456s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:23:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:23:59 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba Jul 29 16:23:59 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:23:59 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l Jul 29 16:23:59 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-03b41c47-4237-4dc4-bd7d-f76bd531af89-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-03b41c47-4237-4dc4-bd7d-f76bd531af89-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-03b41c47-4237-4dc4-bd7d-f76bd531af89" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-03b41c47-4237-4dc4-bd7d-f76bd531af89" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db4f6c-62e4-43ff-a02f-557f47987c50]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:00 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l" returned: 1 in 0.411s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7eaee99-1769-4116-b056-708685019abc_mvi7jx5l' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b981402-d9c8-46f4-9314-f73436dc9406]: (4, 'raw') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:00 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 Jul 29 16:24:00 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:00 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba" returned: 0 in 0.507s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:00 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD Jul 29 16:24:00 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:00 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba Jul 29 16:24:00 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:00 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8.3a9ffdcb-86b0-479f-8799-93e79e328eba" returned: 0 in 0.300s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:00 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:00 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89" returned: 0 in 0.487s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-3a9ffdcb-86b0-479f-8799-93e79e328eba" released by "_delete_snapshot" :: held 2.058s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:00 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89 Jul 29 16:24:00 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-8a0bca6d-dc10-4140-b484-d29e23c4cab8" released by "delete_snapshot" :: held 2.094s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Created reservations ['c9474775-3259-45e6-bf41-84b06e1a2454', 'b778299d-5f67-4ea3-b891-78db3b4f79d4', '6eb3ac18-415d-43cb-8482-b61e32498791', 'a305f5be-761d-4d3b-8d3d-0561afdea3dc'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:00 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD Jul 29 16:24:00 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Delete snapshot completed successfully. Jul 29 16:24:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ec432fda-d374-43f5-be21-4a75b9ccc034 tempest-ProjectReaderTests-504587999 None] Lock "cinder-3a9ffdcb-86b0-479f-8799-93e79e328eba-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:01 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-03b41c47-4237-4dc4-bd7d-f76bd531af89" returned: 0 in 0.331s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-03b41c47-4237-4dc4-bd7d-f76bd531af89" released by "delete_volume" :: held 0.871s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['2900c7f8-d943-4423-bf05-7d5f80a8414a', '6e37a8bf-88ec-40a1-89d7-e626150af57c', '29d05fe7-080e-4b9b-8c9f-10b21ab8fc98', '4165b712-7caa-4bca-9281-f8091eac6614'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:01 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD' failed. Not Retrying. {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] d7eaee99-1769-4116-b056-708685019abc was raw, converting to qcow2 {{(pid=88575) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:01 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 Jul 29 16:24:01 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:01 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:01 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905" acquired by "delete_volume" :: waited 0.043s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4705620-3531-41ff-8afd-3b1268cfaf1d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:01 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 Jul 29 16:24:01 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:01 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.433s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:01 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleted volume successfully. Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-13a523c0-3de2-4fa3-9d16-db42dc7fae59 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-03b41c47-4237-4dc4-bd7d-f76bd531af89-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-8a0bca6d-dc10-4140-b484-d29e23c4cab8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Lock "cinder-8a0bca6d-dc10-4140-b484-d29e23c4cab8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:01 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" returned: 0 in 0.767s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d7eaee99-1769-4116-b056-708685019abc_yn4jku7udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:24:01 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Converted 0.00 MB image at 0.00 MB/s Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=229,cinder:SELECT=149,cinder:INSERT=47,cinder:DELETE=22 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:24:01 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 1G Jul 29 16:24:01 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-8a0bca6d-dc10-4140-b484-d29e23c4cab8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-8a0bca6d-dc10-4140-b484-d29e23c4cab8" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:02 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905" returned: 0 in 0.502s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b33c48-a96a-447e-8853-163c9084ea00]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:02 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905 Jul 29 16:24:02 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:02 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 Jul 29 16:24:02 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:02 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905" returned: 0 in 0.321s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:02 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 1G" returned: 0 in 0.479s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Downloaded image d7eaee99-1769-4116-b056-708685019abc ((None, [{'url': 'file:///opt/stack/data/glance/images/d7eaee99-1769-4116-b056-708685019abc', 'metadata': {}}])) to volume eff06b3c-bf9a-47f7-bb36-cf1a407c7211 successfully. {{(pid=88575) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Temporary image d7eaee99-1769-4116-b056-708685019abc for user 1dd00a895b73448290857e00ccb60459 is deleted. {{(pid=88575) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.volume_utils [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Marking volume eff06b3c-bf9a-47f7-bb36-cf1a407c7211 as bootable. {{(pid=88575) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905" released by "delete_volume" :: held 0.884s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Copying metadata from image d7eaee99-1769-4116-b056-708685019abc to eff06b3c-bf9a-47f7-bb36-cf1a407c7211. {{(pid=88575) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Creating volume glance metadata for volume eff06b3c-bf9a-47f7-bb36-cf1a407c7211 backed by image d7eaee99-1769-4116-b056-708685019abc with: {'image_id': 'd7eaee99-1769-4116-b056-708685019abc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f19290e359286a333975f12422175118', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88575) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['79d83de3-e1a3-41f7-9179-71f8615ffe68', '7c297894-ed13-4bab-948c-4f30a86f4bf1', '3b438563-015f-4a21-887d-e946248e18ad', '0f3298e3-7897-4331-83b0-e132ed7d25c5'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c350aa90-4b8a-43eb-b13f-6cbdbf84b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211', 'volume_size': 1, 'image_id': 'd7eaee99-1769-4116-b056-708685019abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7eaee99-1769-4116-b056-708685019abc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f19290e359286a333975f12422175118', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b2c48de4666435984adbda68e143ac4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '089225728e42b8da23348a87b494c3a5d15963f83ca3d643d64c1ad5c641258ebe8b9797be4f118b619f34a918328a0763ca14b2fe46439811d4e0da28743297', 'id': 'd7eaee99-1769-4116-b056-708685019abc', 'created_at': datetime.datetime(2026, 7, 29, 14, 23, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 29, 14, 23, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7eaee99-1769-4116-b056-708685019abc/file', 'properties': {}}, 'image_service': }' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17b6383-fb3a-43de-9c51-6b2c37674ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:02 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Volume volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 (eff06b3c-bf9a-47f7-bb36-cf1a407c7211): created successfully Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17b6383-fb3a-43de-9c51-6b2c37674ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Flow 'volume_create_manager' (d91467ca-fb1a-4da7-abec-f5214f182ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:02 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8" returned: 0 in 0.508s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8bbc6c06-bee8-4ac8-bcbf-297a295e71ea tempest-VolumeImageDependencyTests-610512837 None] Created volume successfully. Jul 29 16:24:02 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8 Jul 29 16:24:02 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:02 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:02 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:02 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8a0bca6d-dc10-4140-b484-d29e23c4cab8" returned: 0 in 0.284s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-8a0bca6d-dc10-4140-b484-d29e23c4cab8" released by "delete_volume" :: held 0.871s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Created reservations ['e4dd17e7-72b7-401d-91a3-af3cf91ec613', 'bb79d997-b917-425e-ab9e-4190366d15cb', '4d80d8fc-c8cb-47ec-b1f5-ccf883e85144', 'aea11c45-3dec-48d2-8379-9973c6ff32f2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:02 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.299s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleted volume successfully. Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7e1c3a57-68b5-4a5f-b571-783080c7d4ce tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-cb51c5b0-30b0-4c9d-b6cc-783c9b70f905-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:03 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:03 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:03 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.308s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Deleted volume successfully. Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-55bd2448-a939-4e96-b409-a6fad90cec7c tempest-ProjectReaderTests-504587999 None] Lock "cinder-8a0bca6d-dc10-4140-b484-d29e23c4cab8-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Acquiring lock "cinder-eff06b3c-bf9a-47f7-bb36-cf1a407c7211-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Lock "cinder-eff06b3c-bf9a-47f7-bb36-cf1a407c7211-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Acquiring lock "cinder-quobyte-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-571222bb-220f-4612-af37-94af730e893c-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (177ac782-5ec9-459e-95e8-d63ae830d144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf54b1a-c8ef-4252-865e-0898c04e3342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Lock "cinder-quobyte-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" acquired by "delete_volume" :: waited 0.074s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-571222bb-220f-4612-af37-94af730e893c-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf54b1a-c8ef-4252-865e-0898c04e3342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845993582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64148cdb-0940-4e5b-be44-7688f464a555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:04Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e14ba2-36fa-45bd-a9ec-e33a0cc80083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e14ba2-36fa-45bd-a9ec-e33a0cc80083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93776572-fada-403b-bf6c-e52fef8eb16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93776572-fada-403b-bf6c-e52fef8eb16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64148cdb-0940-4e5b-be44-7688f464a555', 'volume_name': 'volume-64148cdb-0940-4e5b-be44-7688f464a555', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea8d9db-a8c4-4ed0-8231-1665744b1992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea8d9db-a8c4-4ed0-8231-1665744b1992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c07150-da20-4124-8a93-e8d490c0989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Volume 64148cdb-0940-4e5b-be44-7688f464a555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64148cdb-0940-4e5b-be44-7688f464a555', 'volume_size': 1} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845993582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64148cdb-0940-4e5b-be44-7688f464a555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:04Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Creating volume 64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:03 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2dc6c-5ca2-4c44-b257-a28bb52b781d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:03 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 1073741824 Jul 29 16:24:03 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-571222bb-220f-4612-af37-94af730e893c" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-571222bb-220f-4612-af37-94af730e893c" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9204a-d6b8-4500-8ed6-23840edf6902]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:04 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 Jul 29 16:24:04 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:04 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c Jul 29 16:24:04 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:04 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" returned: 0 in 0.526s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:04 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:04 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c" returned: 0 in 0.467s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 1073741824" returned: 0 in 0.561s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:04 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211 Jul 29 16:24:04 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:04 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c Jul 29 16:24:04 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:04 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 Jul 29 16:24:04 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:04 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" returned: 0 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Lock "cinder-quobyte-eff06b3c-bf9a-47f7-bb36-cf1a407c7211" released by "delete_volume" :: held 1.055s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:04 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-571222bb-220f-4612-af37-94af730e893c" returned: 0 in 0.471s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:04 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555" returned: 0 in 0.425s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-571222bb-220f-4612-af37-94af730e893c" released by "delete_volume" :: held 0.993s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c07150-da20-4124-8a93-e8d490c0989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64148cdb-0940-4e5b-be44-7688f464a555', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71273d2-10a7-437c-910e-31645a417863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Created reservations ['8a555416-9e6b-47f3-a2ad-2181f62f76ad', 'ed679a8d-5915-4219-855b-f1f7542781b8', '3a987f0b-23d5-407a-ae8b-2e32df998409', '2226ee1c-ced5-4258-be57-455e7194a6d9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:04 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Volume volume-64148cdb-0940-4e5b-be44-7688f464a555 (64148cdb-0940-4e5b-be44-7688f464a555): created successfully Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71273d2-10a7-437c-910e-31645a417863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:04 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (177ac782-5ec9-459e-95e8-d63ae830d144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0ababbcd-728b-4199-aadf-18b1ae63de7e tempest-ProjectReaderTests-504587999 None] Created volume successfully. Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['092aeaf8-b097-4f0d-b69f-95a3d48fcc43', '528d30e9-0475-408f-8e84-b0916f221f90', 'e9256079-0e36-4e6e-b32a-a2f96874fb8b', '9e856095-cd8f-4c92-96ca-e805cd70eb06'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:05 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:05 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:05 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:05 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:05 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.294s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Deleted volume successfully. Jul 29 16:24:05 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3a6b975c-6c9c-46e0-b514-a00826440e2f tempest-VolumeImageDependencyTests-610512837 None] Lock "cinder-eff06b3c-bf9a-47f7-bb36-cf1a407c7211-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:05 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleted volume successfully. Jul 29 16:24:05 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-f7d9abe7-d950-41ff-967c-a1245d5b68e6 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-571222bb-220f-4612-af37-94af730e893c-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-b80d6533-c93c-4b1d-9922-82f9b53795c1-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-b80d6533-c93c-4b1d-9922-82f9b53795c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-2ae8aa90-a1d2-484f-bf69-16e713900fcb" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-2ae8aa90-a1d2-484f-bf69-16e713900fcb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-b80d6533-c93c-4b1d-9922-82f9b53795c1" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-b80d6533-c93c-4b1d-9922-82f9b53795c1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleting offline snapshot b80d6533-c93c-4b1d-9922-82f9b53795c1 of volume 2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] snapshot_file for this snap is: volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61d0f7a-f6f4-4f14-8209-656ad7a425f5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:06 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 Jul 29 16:24:06 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Creating offline snapshot 1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 of volume 64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c35d5c-db67-4e11-b2cb-a24f422ff558]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:06 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 Jul 29 16:24:06 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:06 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1" returned: 0 in 0.569s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d29147-f213-443c-8a52-1d94b05fe566]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:06 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb Jul 29 16:24:06 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:07 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555" returned: 0 in 0.540s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:07 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 1G Jul 29 16:24:07 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:07 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb" returned: 0 in 0.612s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:07 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 Jul 29 16:24:07 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:07 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 1G" returned: 0 in 0.711s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64148cdb-0940-4e5b-be44-7688f464a555 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:07 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64148cdb-0940-4e5b-be44-7688f464a555 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 Jul 29 16:24:07 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:07 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1" returned: 0 in 0.477s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:07 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1 Jul 29 16:24:07 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:08 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64148cdb-0940-4e5b-be44-7688f464a555 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" returned: 0 in 0.427s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:08 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 is being set with open permissions: ugo+rw Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:08 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 Jul 29 16:24:08 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:08 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb.b80d6533-c93c-4b1d-9922-82f9b53795c1" returned: 0 in 0.359s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-b80d6533-c93c-4b1d-9922-82f9b53795c1" released by "_delete_snapshot" :: held 2.192s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-2ae8aa90-a1d2-484f-bf69-16e713900fcb" released by "delete_snapshot" :: held 2.233s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['aab03bbb-876d-430a-b7f7-de8a860d6739', '9428e42b-0eb6-40ff-b060-c5fbd4e00934', 'e0b9c4b6-630c-4d4a-93b7-8b1bea0ddd72', '0906334e-4218-4980-962a-69845f4c0f4b'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:08 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:08 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Delete snapshot completed successfully. Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-323bf2f0-09cd-4ddf-b632-3d84a81df2f1 tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-b80d6533-c93c-4b1d-9922-82f9b53795c1-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:08 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info Jul 29 16:24:08 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:08 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info" returned: 0 in 0.341s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:08 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info is being set with open permissions: ugo+rw Jul 29 16:24:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:08 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info Jul 29 16:24:08 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:09 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.info" returned: 0 in 0.335s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.859s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-2ae8aa90-a1d2-484f-bf69-16e713900fcb-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-2ae8aa90-a1d2-484f-bf69-16e713900fcb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4ae30ff9-d5e5-49a6-998d-a198707e7be9 tempest-ProjectReaderTests-504587999 None] Create snapshot completed successfully Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "cinder-quobyte-2ae8aa90-a1d2-484f-bf69-16e713900fcb" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-2ae8aa90-a1d2-484f-bf69-16e713900fcb" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0575d-f13c-4e97-8106-287446cc7627]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-1ef22e84-c9d7-4b14-99c9-5ea7da5591f8-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Lock "cinder-1ef22e84-c9d7-4b14-99c9-5ea7da5591f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:09 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb Jul 29 16:24:09 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-64148cdb-0940-4e5b-be44-7688f464a555" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-64148cdb-0940-4e5b-be44-7688f464a555" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Deleting offline snapshot 1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 of volume 64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] snapshot_file for this snap is: volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e3619-8cb1-4019-85ee-cc107af1a443]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:09 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 Jul 29 16:24:09 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:10 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb" returned: 0 in 0.555s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:10 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb Jul 29 16:24:10 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:10 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" returned: 0 in 0.505s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64148cdb-0940-4e5b-be44-7688f464a555(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f711f81-eba3-4c82-a445-252b25081100]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:10 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2ae8aa90-a1d2-484f-bf69-16e713900fcb" returned: 0 in 0.349s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-quobyte-2ae8aa90-a1d2-484f-bf69-16e713900fcb" released by "delete_volume" :: held 0.985s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:10 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 Jul 29 16:24:10 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Flow 'volume_create_manager' (b2b38e8d-2eca-49a5-b4c8-0b60230d4076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2be38b3-5e51-4194-b7a1-66cffd05fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2be38b3-5e51-4194-b7a1-66cffd05fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39ac58d-f846-41db-a0d8-92510d40049b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1819dc67d94a4077bbe5edd7ece86be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:10Z,use_quota=True,user_id='fa6be54e31c94fc694aed20e20f5029b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a742fb96-88f3-4b19-acfd-8a64736bb5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a742fb96-88f3-4b19-acfd-8a64736bb5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe61812-f3fc-448e-8e4b-edc8644c6274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe61812-f3fc-448e-8e4b-edc8644c6274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39ac58d-f846-41db-a0d8-92510d40049b', 'volume_name': 'volume-e39ac58d-f846-41db-a0d8-92510d40049b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0d53c4-2543-40cf-a08d-061906af7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0d53c4-2543-40cf-a08d-061906af7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a108d0a-709f-41e3-bb38-d26d3188ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:10 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Volume e39ac58d-f846-41db-a0d8-92510d40049b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39ac58d-f846-41db-a0d8-92510d40049b', 'volume_size': 1} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39ac58d-f846-41db-a0d8-92510d40049b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1819dc67d94a4077bbe5edd7ece86be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:10Z,use_quota=True,user_id='fa6be54e31c94fc694aed20e20f5029b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Creating volume e39ac58d-f846-41db-a0d8-92510d40049b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:10 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Created reservations ['752f9351-992f-4baa-8748-c00b24536319', 'ecc8f93f-ff7c-4491-b825-a9f93433a60d', '58bb2580-1af1-47c1-9df5-5cedcb03e9f7', '54f6428f-7f84-4a75-8509-37eb11a73628'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:10 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b 1073741824 Jul 29 16:24:10 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:10 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:10 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:10 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555" returned: 0 in 0.509s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:10 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 Jul 29 16:24:10 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:11 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.287s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Deleted volume successfully. Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-31ecc657-0c33-4858-9d56-98b3c39d4fba tempest-CreateVolumesFromSnapshotTest-524728917 None] Lock "cinder-2ae8aa90-a1d2-484f-bf69-16e713900fcb-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:11 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b 1073741824" returned: 0 in 0.591s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:11 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b Jul 29 16:24:11 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:11 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" returned: 0 in 0.499s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:11 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8 Jul 29 16:24:11 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:11 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b" returned: 0 in 0.352s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a108d0a-709f-41e3-bb38-d26d3188ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39ac58d-f846-41db-a0d8-92510d40049b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf01953-b01f-44ab-831d-9cb404b95b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=210,cinder:UPDATE=263,cinder:DELETE=23,cinder:INSERT=83 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:24:11 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Volume volume-e39ac58d-f846-41db-a0d8-92510d40049b (e39ac58d-f846-41db-a0d8-92510d40049b): created successfully Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf01953-b01f-44ab-831d-9cb404b95b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Flow 'volume_create_manager' (b2b38e8d-2eca-49a5-b4c8-0b60230d4076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:11 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555.1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5eb9f8db-8f4a-4802-ba44-54dd60217042 tempest-CinderUnicodeTest-47850798 None] Created volume successfully. Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-1ef22e84-c9d7-4b14-99c9-5ea7da5591f8" released by "_delete_snapshot" :: held 2.055s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-64148cdb-0940-4e5b-be44-7688f464a555" released by "delete_snapshot" :: held 2.104s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:11 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Created reservations ['de152766-925c-4391-858d-4c0dec4a0d24', '792add4b-e3df-4fc0-95ec-4f78056b5408', 'ffe6fa7d-c84b-437f-af98-71b0618c3cd7', '16a0892b-ca56-42fd-9a6a-43b1110b7ab3'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Delete snapshot completed successfully. Jul 29 16:24:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e0de88eb-c071-407e-8e1d-191a9ff6f267 tempest-ProjectReaderTests-504587999 None] Lock "cinder-1ef22e84-c9d7-4b14-99c9-5ea7da5591f8-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-64148cdb-0940-4e5b-be44-7688f464a555-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:12 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Lock "cinder-64148cdb-0940-4e5b-be44-7688f464a555-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-64148cdb-0940-4e5b-be44-7688f464a555" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-64148cdb-0940-4e5b-be44-7688f464a555" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bbfa15-6f88-490d-bbe6-210077f3a117]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Flow 'volume_create_manager' (e1b21cb7-a493-46d8-ba27-04a81a7dc869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53a16fd-4e33-4035-850e-194a9891df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:13 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53a16fd-4e33-4035-850e-194a9891df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1378330902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f64d08a-3675-4831-84fc-c8e80889d669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1819dc67d94a4077bbe5edd7ece86be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:13Z,use_quota=True,user_id='fa6be54e31c94fc694aed20e20f5029b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:13 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f877f0-173d-4209-be27-ca3796125ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f877f0-173d-4209-be27-ca3796125ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0341f6d5-0018-474e-9ed5-931ad162ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0341f6d5-0018-474e-9ed5-931ad162ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f64d08a-3675-4831-84fc-c8e80889d669', 'volume_name': 'volume-5f64d08a-3675-4831-84fc-c8e80889d669', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dac6d62-9684-40c6-867a-c7054c09fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dac6d62-9684-40c6-867a-c7054c09fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad091b7-e9c3-4789-a211-84f4416dd681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:13 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Volume 5f64d08a-3675-4831-84fc-c8e80889d669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f64d08a-3675-4831-84fc-c8e80889d669', 'volume_size': 1} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1378330902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f64d08a-3675-4831-84fc-c8e80889d669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1819dc67d94a4077bbe5edd7ece86be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:13Z,use_quota=True,user_id='fa6be54e31c94fc694aed20e20f5029b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Creating volume 5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:13 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:13 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 1073741824 Jul 29 16:24:13 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:13 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555" returned: 0 in 0.558s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:13 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555 Jul 29 16:24:13 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:14 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-64148cdb-0940-4e5b-be44-7688f464a555" returned: 0 in 0.365s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:14 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 1073741824" returned: 0 in 0.701s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-64148cdb-0940-4e5b-be44-7688f464a555" released by "delete_volume" :: held 1.091s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:14 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 Jul 29 16:24:14 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Flow 'volume_create_manager' (e0dc4b92-9030-4e95-9162-71d477d98802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e5a162-5e31-45c1-a276-8db83abc1860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Created reservations ['962a37f3-7f6a-4d83-bbcc-38cf5d64fe68', '12265441-77be-4f2b-80fa-ae64e58ac97e', '63c4fc94-8811-4f2e-ba16-c0cbe975296c', '83c5cb76-3e40-4dd9-a26d-177abf2658cb'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e5a162-5e31-45c1-a276-8db83abc1860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2026021530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce36e86a-81ad-4d37-9ee6-d695ac422798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16eb5e579e2b4421b807f8f9cc035ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:14Z,use_quota=True,user_id='e6417c62645341cfb836d6e1241cea6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ce6f94-4bcb-44b0-89e2-ffa7470b60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ce6f94-4bcb-44b0-89e2-ffa7470b60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a6b86f-3fb9-4fc1-b358-87c981f64265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a6b86f-3fb9-4fc1-b358-87c981f64265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce36e86a-81ad-4d37-9ee6-d695ac422798', 'volume_name': 'volume-ce36e86a-81ad-4d37-9ee6-d695ac422798', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cbc289-3b61-40b2-8394-639d71caae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cbc289-3b61-40b2-8394-639d71caae2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c3bb19-f0d2-45f3-be60-da6c572df953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Volume ce36e86a-81ad-4d37-9ee6-d695ac422798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce36e86a-81ad-4d37-9ee6-d695ac422798', 'volume_size': 1} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:14 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:14 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:14 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2026021530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce36e86a-81ad-4d37-9ee6-d695ac422798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16eb5e579e2b4421b807f8f9cc035ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:14Z,use_quota=True,user_id='e6417c62645341cfb836d6e1241cea6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Creating volume ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:14 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:14 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 1073741824 Jul 29 16:24:14 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad091b7-e9c3-4789-a211-84f4416dd681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f64d08a-3675-4831-84fc-c8e80889d669', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c1350f-097c-4ba9-82cf-8cb2ca964a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Volume volume-5f64d08a-3675-4831-84fc-c8e80889d669 (5f64d08a-3675-4831-84fc-c8e80889d669): created successfully Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c1350f-097c-4ba9-82cf-8cb2ca964a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Flow 'volume_create_manager' (e1b21cb7-a493-46d8-ba27-04a81a7dc869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-60638589-4244-445b-b476-698570f31d8c tempest-CinderUnicodeTest-47850798 None] Created volume successfully. Jul 29 16:24:14 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.280s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Deleted volume successfully. Jul 29 16:24:14 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-521b347d-70a1-4b1e-a570-0c0e3026fd15 tempest-ProjectReaderTests-504587999 None] Lock "cinder-64148cdb-0940-4e5b-be44-7688f464a555-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:15 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 1073741824" returned: 0 in 0.471s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:15 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:15 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:15 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.315s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c3bb19-f0d2-45f3-be60-da6c572df953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce36e86a-81ad-4d37-9ee6-d695ac422798', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6830dae-e1d0-48d2-a0da-1dceec700d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:15 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Volume volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 (ce36e86a-81ad-4d37-9ee6-d695ac422798): created successfully Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6830dae-e1d0-48d2-a0da-1dceec700d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Flow 'volume_create_manager' (e0dc4b92-9030-4e95-9162-71d477d98802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:15 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-96e2c2f4-be6b-49c5-a81f-05a7d040c46d tempest-SnapshotDependencyTests-1334811284 None] Created volume successfully. Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Creating offline snapshot ff22168b-f9c7-4c4c-9355-706820004465 of volume 5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d12be7-ecef-4144-b68c-f90b728e56b5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (680e35e5-c94a-4443-8784-07de7292a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c641c1a-c871-475b-979d-a870c8948ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c641c1a-c871-475b-979d-a870c8948ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1663795806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4fabfe-67f8-40fc-8610-4d28eb4026a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:16Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a469c63-22ee-46b7-9c13-638e11e89786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a469c63-22ee-46b7-9c13-638e11e89786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb0699a-08f6-47df-882a-b2c8cc08fa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb0699a-08f6-47df-882a-b2c8cc08fa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4fabfe-67f8-40fc-8610-4d28eb4026a8', 'volume_name': 'volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686162b4-b91f-437a-b6b4-43fd8b5c06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:15 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686162b4-b91f-437a-b6b4-43fd8b5c06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753e867e-2007-44bd-b55f-f9931e7e9143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:16 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Volume de4fabfe-67f8-40fc-8610-4d28eb4026a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8', 'volume_size': 1} Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:16 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 Jul 29 16:24:16 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:16 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669" returned: 0 in 0.395s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:16 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 1G Jul 29 16:24:16 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:16 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 1G" returned: 0 in 0.490s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f64d08a-3675-4831-84fc-c8e80889d669 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:16 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f64d08a-3675-4831-84fc-c8e80889d669 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 Jul 29 16:24:16 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:17 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f64d08a-3675-4831-84fc-c8e80889d669 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465" returned: 0 in 0.317s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:17 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 is being set with open permissions: ugo+rw Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:17 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 Jul 29 16:24:17 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:17 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:17 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info Jul 29 16:24:17 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:17 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:17 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info is being set with open permissions: ugo+rw Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:17 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info Jul 29 16:24:17 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:17 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.info" returned: 0 in 0.240s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1663795806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4fabfe-67f8-40fc-8610-4d28eb4026a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:16Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Creating volume de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:17 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:17 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 1073741824 Jul 29 16:24:17 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:17 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6de6ae5c-fd23-44c6-a543-5e93601935ca tempest-CinderUnicodeTest-47850798 None] Create snapshot completed successfully Jul 29 16:24:18 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 1073741824" returned: 0 in 0.490s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:18 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 Jul 29 16:24:18 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:18 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8" returned: 0 in 0.294s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.149s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Creating offline snapshot b5b419ef-67be-4ebf-8620-432141a69c16 of volume ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753e867e-2007-44bd-b55f-f9931e7e9143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4318a3ee-962c-47db-b438-166dd2992c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[efac92a6-f070-4794-9e90-3441009b7339]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:18 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Volume volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 (de4fabfe-67f8-40fc-8610-4d28eb4026a8): created successfully Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4318a3ee-962c-47db-b438-166dd2992c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (680e35e5-c94a-4443-8784-07de7292a614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ae5fb74f-76f0-4e59-bf97-da12e6934680 tempest-ProjectReaderTests-504587999 None] Created volume successfully. Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-ff22168b-f9c7-4c4c-9355-706820004465-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:18 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:18 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-ff22168b-f9c7-4c4c-9355-706820004465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:18 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-quobyte-5f64d08a-3675-4831-84fc-c8e80889d669" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-5f64d08a-3675-4831-84fc-c8e80889d669" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-quobyte-ff22168b-f9c7-4c4c-9355-706820004465" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-ff22168b-f9c7-4c4c-9355-706820004465" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Deleting offline snapshot ff22168b-f9c7-4c4c-9355-706820004465 of volume 5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] snapshot_file for this snap is: volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[71931ec2-c28e-4371-b18b-0e58651ad9e9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:19 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 Jul 29 16:24:19 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:19 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.501s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:19 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 1G Jul 29 16:24:19 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:19 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465" returned: 0 in 0.480s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f64d08a-3675-4831-84fc-c8e80889d669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a293172-734f-43cf-bec5-300f458dd854]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:19 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 Jul 29 16:24:19 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:19 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 1G" returned: 0 in 0.519s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:19 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 Jul 29 16:24:19 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:20 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669" returned: 0 in 0.414s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:20 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 Jul 29 16:24:20 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:20 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16" returned: 0 in 0.369s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:20 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 is being set with open permissions: ugo+rw Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:20 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 Jul 29 16:24:20 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:20 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465" returned: 0 in 0.392s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:20 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465 Jul 29 16:24:20 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:20 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16" returned: 0 in 0.281s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:20 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info Jul 29 16:24:20 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:20 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669.ff22168b-f9c7-4c4c-9355-706820004465" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-ff22168b-f9c7-4c4c-9355-706820004465" released by "_delete_snapshot" :: held 1.728s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-5f64d08a-3675-4831-84fc-c8e80889d669" released by "delete_snapshot" :: held 1.761s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Created reservations ['87d10b24-4164-47fd-80f8-d83f83270a14', '256a4986-45bf-4895-be20-7c79f6cedd0a', '64553c6e-bca8-4c0d-9944-b0e36f01d7e5', '11846323-ea30-424a-a64b-cc88123335d9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:20 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info" returned: 0 in 0.294s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:20 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info is being set with open permissions: ugo+rw Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:20 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info Jul 29 16:24:20 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Delete snapshot completed successfully. Jul 29 16:24:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-b4151647-618a-491d-9b37-3cf159f19357 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-ff22168b-f9c7-4c4c-9355-706820004465-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:21 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.info" returned: 0 in 0.265s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.743s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-5f64d08a-3675-4831-84fc-c8e80889d669-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Creating offline snapshot 669b2714-40a7-4d3c-b60d-023c226ab120 of volume de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:21 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3e2b5e42-3618-4de8-b039-239ea57fb32c tempest-SnapshotDependencyTests-1334811284 None] Create snapshot completed successfully Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-5f64d08a-3675-4831-84fc-c8e80889d669-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da96cf2-4144-42a3-8e6f-5b91fdcc10d1]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-quobyte-5f64d08a-3675-4831-84fc-c8e80889d669" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-5f64d08a-3675-4831-84fc-c8e80889d669" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c770725-1daa-4cce-ad9d-9698cab2a54d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:21 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 Jul 29 16:24:21 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:21 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 Jul 29 16:24:21 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:21 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:21 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 1G Jul 29 16:24:21 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:21 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669" returned: 0 in 0.424s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:21 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669 Jul 29 16:24:21 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:22 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5f64d08a-3675-4831-84fc-c8e80889d669" returned: 0 in 0.328s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-5f64d08a-3675-4831-84fc-c8e80889d669" released by "delete_volume" :: held 0.820s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Created reservations ['0cce95aa-45e2-40e2-b425-39a4707423dc', '6b27ab7b-f45e-4742-a21b-2791ef805d77', '975f4575-6f3f-490a-8f76-4a3ebea825ad', '01580eec-7f6b-4afe-828c-72b7e343eeaf'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:22 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 1G" returned: 0 in 0.560s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:22 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 Jul 29 16:24:22 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:22 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:22 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-e39ac58d-f846-41db-a0d8-92510d40049b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-e39ac58d-f846-41db-a0d8-92510d40049b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "cinder-quobyte-e39ac58d-f846-41db-a0d8-92510d40049b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-e39ac58d-f846-41db-a0d8-92510d40049b" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[98401a13-3094-4e9b-8126-ac91d7c21f60]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:22 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120" returned: 0 in 0.422s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:22 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 is being set with open permissions: ugo+rw Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:22 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 Jul 29 16:24:22 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:22 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b Jul 29 16:24:22 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Flow 'volume_create_manager' (77d9cf09-528b-4a44-9c14-429ecbbf0e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6feda8-de56-4024-a93f-40ceb42dc459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:22 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.549s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6feda8-de56-4024-a93f-40ceb42dc459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af01a15b-ce5b-401b-b6ec-938c316196b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16eb5e579e2b4421b807f8f9cc035ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5b419ef-67be-4ebf-8620-432141a69c16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:23Z,use_quota=True,user_id='e6417c62645341cfb836d6e1241cea6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f13405-f207-4727-a168-04a39c7fd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f13405-f207-4727-a168-04a39c7fd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4a5f47-18f9-4a00-ae2a-257697720f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4a5f47-18f9-4a00-ae2a-257697720f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af01a15b-ce5b-401b-b6ec-938c316196b2', 'volume_name': 'volume-af01a15b-ce5b-401b-b6ec-938c316196b2', 'volume_size': 1, 'snapshot_id': 'b5b419ef-67be-4ebf-8620-432141a69c16'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bdac53-0fd7-4697-b5fe-67380c25589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bdac53-0fd7-4697-b5fe-67380c25589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e14040-9e54-40d2-b225-d570141a448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Volume af01a15b-ce5b-401b-b6ec-938c316196b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af01a15b-ce5b-401b-b6ec-938c316196b2', 'volume_size': 1, 'snapshot_id': 'b5b419ef-67be-4ebf-8620-432141a69c16'} Jul 29 16:24:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Deleted volume successfully. Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5ecee387-592d-4945-af54-c49989b657c5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-5f64d08a-3675-4831-84fc-c8e80889d669-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:22 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120" returned: 0 in 0.353s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:23 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info Jul 29 16:24:23 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:23 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b" returned: 0 in 0.513s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:23 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b Jul 29 16:24:23 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:23 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:23 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info is being set with open permissions: ugo+rw Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:23 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info Jul 29 16:24:23 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:23 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-e39ac58d-f846-41db-a0d8-92510d40049b" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-quobyte-e39ac58d-f846-41db-a0d8-92510d40049b" released by "delete_volume" :: held 0.847s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Created reservations ['f54a2150-e3da-4ac6-aaae-a4591c993b8a', 'a84b722a-4619-4078-8bc5-769492398d80', 'fd9d8838-6f8b-49b7-a703-b4501dfac4f9', '3f81c037-7d38-42ef-9ad7-ca11ac3a4f5f'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:23 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:23 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:23 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.info" returned: 0 in 0.327s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.745s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-quobyte-b5b419ef-67be-4ebf-8620-432141a69c16-af01a15b-ce5b-401b-b6ec-938c316196b2" by "_create_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-b5b419ef-67be-4ebf-8620-432141a69c16-af01a15b-ce5b-401b-b6ec-938c316196b2" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Creating volume af01a15b-ce5b-401b-b6ec-938c316196b2 from snapshot b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-quobyte-af01a15b-ce5b-401b-b6ec-938c316196b2" by "_copy_volume_from_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-09af2a0a-e2b5-42ad-a8bf-9e9734d82e8b tempest-ProjectReaderTests-504587999 None] Create snapshot completed successfully Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-af01a15b-ce5b-401b-b6ec-938c316196b2" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] snapshot: b5b419ef-67be-4ebf-8620-432141a69c16, volume: af01a15b-ce5b-401b-b6ec-938c316196b2, {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec00a7-4c54-40c1-b805-63ad55d173b6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:23 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.338s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Deleted volume successfully. Jul 29 16:24:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-59910e04-9a31-4b54-9b98-281c3248d0d5 tempest-CinderUnicodeTest-47850798 None] Lock "cinder-e39ac58d-f846-41db-a0d8-92510d40049b-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:23 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 Jul 29 16:24:23 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:24 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce36e86a-81ad-4d37-9ee6-d695ac422798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Creating direct copy from snapshot {{(pid=88575) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[11831924-2d9d-4a05-9eb9-2e31207ba09e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:24 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:24 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:24 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.utils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Path /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 not found in is_blk_device check {{(pid=88575) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-669b2714-40a7-4d3c-b60d-023c226ab120-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:24 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 Jul 29 16:24:24 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Lock "cinder-669b2714-40a7-4d3c-b60d-023c226ab120-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-de4fabfe-67f8-40fc-8610-4d28eb4026a8" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-de4fabfe-67f8-40fc-8610-4d28eb4026a8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-669b2714-40a7-4d3c-b60d-023c226ab120" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-669b2714-40a7-4d3c-b60d-023c226ab120" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Deleting offline snapshot 669b2714-40a7-4d3c-b60d-023c226ab120 of volume de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] snapshot_file for this snap is: volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026a5c9-e1de-4831-8f38-046f051cf949]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:25 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 Jul 29 16:24:25 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:25 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120" returned: 0 in 0.494s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:25 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ccb162-bda8-44d2-b0a8-cfc72e09d1fb]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:25 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 Jul 29 16:24:25 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:26 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8" returned: 0 in 1.305s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:26 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 Jul 29 16:24:26 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:28 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120" returned: 0 in 1.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:28 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120 Jul 29 16:24:28 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:28 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8.669b2714-40a7-4d3c-b60d-023c226ab120" returned: 0 in 0.755s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-669b2714-40a7-4d3c-b60d-023c226ab120" released by "_delete_snapshot" :: held 4.036s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-de4fabfe-67f8-40fc-8610-4d28eb4026a8" released by "delete_snapshot" :: held 4.089s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:29 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Created reservations ['09d7424e-6574-4b88-8d90-da798150a701', 'c648ce26-aef2-4ed5-a91c-3527165a8493', 'b309a58e-490e-43d1-b2db-29f849d9d3b9', '7615cfdc-8aee-4cf8-9f65-281dbdb1dd27'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:29 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Delete snapshot completed successfully. Jul 29 16:24:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a6ddde7b-6696-4ca4-af75-56c395c8d9f3 tempest-ProjectReaderTests-504587999 None] Lock "cinder-669b2714-40a7-4d3c-b60d-023c226ab120-delete_snapshot" released by "delete_snapshot" :: held 4.492s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-de4fabfe-67f8-40fc-8610-4d28eb4026a8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Lock "cinder-de4fabfe-67f8-40fc-8610-4d28eb4026a8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-de4fabfe-67f8-40fc-8610-4d28eb4026a8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-de4fabfe-67f8-40fc-8610-4d28eb4026a8" acquired by "delete_volume" :: waited 0.050s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:30 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ac84ab-9164-402e-9a59-ae5e72cffdcf]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:31 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2" returned: 0 in 6.257s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a9b0b-594b-4cad-9dca-d859e1a11b3c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:31 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 Jul 29 16:24:31 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:31 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:31 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (7a3a4bda-6c80-431d-ab0c-1da4519b1548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46084ca2-3644-49d6-8be6-9e2edb513868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46084ca2-3644-49d6-8be6-9e2edb513868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650107169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:31Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4bdce2-6f9e-4b86-8ea0-02f48e669b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4bdce2-6f9e-4b86-8ea0-02f48e669b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:31 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8e5bfa-34d9-4500-aa8c-b5aa57b2824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8e5bfa-34d9-4500-aa8c-b5aa57b2824e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379', 'volume_name': 'volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683933f7-8bdc-46e9-bc51-68e026b8ed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683933f7-8bdc-46e9-bc51-68e026b8ed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a82da4-b3ee-4eb0-8b88-586b9b95ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:31 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Volume 7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379', 'volume_size': 1} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8" returned: 0 in 0.674s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:31 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8 Jul 29 16:24:31 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:31 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.760s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.image.image_utils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 {{(pid=88575) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 29 16:24:31 devstack cinder-volume[88575]: INFO cinder.image.image_utils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Converted 1024.00 MB image at 163.45 MB/s Jul 29 16:24:31 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 is being set with open permissions: ugo+rw Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:31 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 Jul 29 16:24:31 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:31 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-de4fabfe-67f8-40fc-8610-4d28eb4026a8" returned: 0 in 0.303s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:31 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-de4fabfe-67f8-40fc-8610-4d28eb4026a8" released by "delete_volume" :: held 1.117s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Created reservations ['de282b45-c05e-48ac-a9aa-f945726f4ae9', '25052ec9-b25e-4eef-9409-aaf27a5ff8c7', '86c7e5be-1910-45da-9d9d-f7131b62b41d', 'e99a2e76-fd0f-4873-93ac-69d1513013c2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:32 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-af01a15b-ce5b-401b-b6ec-938c316196b2" released by "_copy_volume_from_snapshot" :: held 8.330s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-b5b419ef-67be-4ebf-8620-432141a69c16-af01a15b-ce5b-401b-b6ec-938c316196b2" released by "_create_volume_from_snapshot" :: held 8.386s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.418s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650107169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:31Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Creating volume 7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:32 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:32 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 1073741824 Jul 29 16:24:32 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:32 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:32 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e14040-9e54-40d2-b225-d570141a448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af01a15b-ce5b-401b-b6ec-938c316196b2', 'volume_size': 1, 'snapshot_id': 'b5b419ef-67be-4ebf-8620-432141a69c16'}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf99e308-7d4b-44e4-9d63-223fbd415db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:32 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Volume volume-af01a15b-ce5b-401b-b6ec-938c316196b2 (af01a15b-ce5b-401b-b6ec-938c316196b2): created successfully Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf99e308-7d4b-44e4-9d63-223fbd415db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Flow 'volume_create_manager' (77d9cf09-528b-4a44-9c14-429ecbbf0e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:32 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-bfe8a78d-f9c2-4281-92ce-487e29249577 tempest-SnapshotDependencyTests-1334811284 None] Created volume successfully. Jul 29 16:24:32 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.326s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:32 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Deleted volume successfully. Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-20d85478-6441-4652-844d-af4f78630b1f tempest-ProjectReaderTests-504587999 None] Lock "cinder-de4fabfe-67f8-40fc-8610-4d28eb4026a8-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:32 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 1073741824" returned: 0 in 0.605s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:32 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 Jul 29 16:24:32 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (422fd676-bdb2-49a8-a5e8-aaf55dd2c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e17b47-5710-46bc-b415-dc07fdbb6e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e17b47-5710-46bc-b415-dc07fdbb6e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438209183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd40aed-7596-47a5-ac27-be9d110c6ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:33Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bc0bda-7787-4cc9-a122-18d5bf00e0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bc0bda-7787-4cc9-a122-18d5bf00e0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4612ee4e-2e6c-4c73-b85d-b33c53ea5c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4612ee4e-2e6c-4c73-b85d-b33c53ea5c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd40aed-7596-47a5-ac27-be9d110c6ede', 'volume_name': 'volume-5dd40aed-7596-47a5-ac27-be9d110c6ede', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e506604d-2803-4f88-a346-3e61b4bbd6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e506604d-2803-4f88-a346-3e61b4bbd6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaa1215-b471-451a-8378-6dc6caa28b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:32 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Volume 5dd40aed-7596-47a5-ac27-be9d110c6ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd40aed-7596-47a5-ac27-be9d110c6ede', 'volume_size': 1} Jul 29 16:24:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:33 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438209183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd40aed-7596-47a5-ac27-be9d110c6ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:33Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Creating volume 5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:33 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a82da4-b3ee-4eb0-8b88-586b9b95ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230a0469-d89c-4a77-a7e5-b91afbaebbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:33 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede 1073741824 Jul 29 16:24:33 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:33 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Volume volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 (7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379): created successfully Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230a0469-d89c-4a77-a7e5-b91afbaebbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (7a3a4bda-6c80-431d-ab0c-1da4519b1548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-651e700f-7cd7-48fe-b962-6ec6a386ec71 tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-b5b419ef-67be-4ebf-8620-432141a69c16-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-b5b419ef-67be-4ebf-8620-432141a69c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-quobyte-ce36e86a-81ad-4d37-9ee6-d695ac422798" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-ce36e86a-81ad-4d37-9ee6-d695ac422798" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-quobyte-b5b419ef-67be-4ebf-8620-432141a69c16" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-b5b419ef-67be-4ebf-8620-432141a69c16" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Deleting offline snapshot b5b419ef-67be-4ebf-8620-432141a69c16 of volume ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] snapshot_file for this snap is: volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f758e46-f0cf-43f8-b355-eaa5be9a2562]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:33 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede 1073741824" returned: 0 in 0.620s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:33 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 Jul 29 16:24:33 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:33 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede Jul 29 16:24:33 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:34 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede" returned: 0 in 0.305s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaa1215-b471-451a-8378-6dc6caa28b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd40aed-7596-47a5-ac27-be9d110c6ede', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc22eab-9a91-4b2a-83ea-303e5ff51406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:34 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16" returned: 0 in 0.532s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce36e86a-81ad-4d37-9ee6-d695ac422798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7aacb-0234-4348-999b-17a01496bf8d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:34 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Volume volume-5dd40aed-7596-47a5-ac27-be9d110c6ede (5dd40aed-7596-47a5-ac27-be9d110c6ede): created successfully Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc22eab-9a91-4b2a-83ea-303e5ff51406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (422fd676-bdb2-49a8-a5e8-aaf55dd2c719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:34 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-313a6dbf-9a55-4bdd-9ad2-5609cd1bdea3 tempest-ProjectReaderTests-504587999 None] Created volume successfully. Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Creating offline snapshot 657d810e-2ce7-48fa-a367-0964909314e0 of volume 7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97ffc49-26ed-479d-baaa-8d8bed69ca6c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:34 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:34 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:34 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 Jul 29 16:24:34 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:34 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.394s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:34 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 Jul 29 16:24:34 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:34 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:34 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 1G Jul 29 16:24:34 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:34 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16" returned: 0 in 0.396s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:34 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16 Jul 29 16:24:34 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:35 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 1G" returned: 0 in 0.572s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:35 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 Jul 29 16:24:35 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:35 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798.b5b419ef-67be-4ebf-8620-432141a69c16" returned: 0 in 0.339s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-b5b419ef-67be-4ebf-8620-432141a69c16" released by "_delete_snapshot" :: held 1.835s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-ce36e86a-81ad-4d37-9ee6-d695ac422798" released by "delete_snapshot" :: held 1.875s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Created reservations ['f3bbf00e-4b78-436f-a8d0-429a4871a291', '28d84578-4f5c-45d9-9481-152a790dd88a', '05df6bc2-8783-4659-a5db-96e596c72e0e', '21387040-cbf6-4309-a0ca-3be9ecd3aba2'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Delete snapshot completed successfully. Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7d41a56f-ef39-4d15-912b-2f6affc88d3e tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-b5b419ef-67be-4ebf-8620-432141a69c16-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:35 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0" returned: 0 in 0.357s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:35 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 is being set with open permissions: ugo+rw Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:35 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 Jul 29 16:24:35 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-ce36e86a-81ad-4d37-9ee6-d695ac422798-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-ce36e86a-81ad-4d37-9ee6-d695ac422798-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-quobyte-ce36e86a-81ad-4d37-9ee6-d695ac422798" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-ce36e86a-81ad-4d37-9ee6-d695ac422798" acquired by "delete_volume" :: waited 0.030s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[548a79c5-b2c3-42c7-9ca7-405cf13fb093]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:35 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0" returned: 0 in 0.320s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:35 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info Jul 29 16:24:35 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:35 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:35 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:36 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info" returned: 0 in 0.314s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:36 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info is being set with open permissions: ugo+rw Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:36 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.397s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:36 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info Jul 29 16:24:36 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:36 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798 Jul 29 16:24:36 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:36 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.info" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:36 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.156s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-ce36e86a-81ad-4d37-9ee6-d695ac422798" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Creating offline snapshot bf9949ca-2f32-4b17-b964-f522f701b525 of volume 5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-ce36e86a-81ad-4d37-9ee6-d695ac422798" released by "delete_volume" :: held 0.756s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a299a661-1587-494d-8747-3dd5f3c98d7e]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:36 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3b8a5b1d-d038-4593-babb-80d921c2bfec tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Created reservations ['4e769cc7-d730-4674-86b5-2ecc781b6d54', '13537821-14de-4bc1-b089-f4f599cbc24a', '134ff2c2-4d08-4851-8f54-11abd61af30e', '2c68f50e-e9e7-4014-85e3-29251936e556'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:36 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede Jul 29 16:24:36 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:36 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:36 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:36 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:36 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-af01a15b-ce5b-401b-b6ec-938c316196b2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-af01a15b-ce5b-401b-b6ec-938c316196b2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:37 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.311s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "cinder-quobyte-af01a15b-ce5b-401b-b6ec-938c316196b2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:37 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede" returned: 0 in 0.500s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:37 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-af01a15b-ce5b-401b-b6ec-938c316196b2" acquired by "delete_volume" :: waited 0.055s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:37 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 1G Jul 29 16:24:37 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Deleted volume successfully. Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b394bc-63b1-4351-b14f-d3d7fc9b61de]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-32938156-16f1-4dee-a97f-5fa3672dd933 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-ce36e86a-81ad-4d37-9ee6-d695ac422798-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:37 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 Jul 29 16:24:37 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-657d810e-2ce7-48fa-a367-0964909314e0-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Lock "cinder-657d810e-2ce7-48fa-a367-0964909314e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-657d810e-2ce7-48fa-a367-0964909314e0" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-657d810e-2ce7-48fa-a367-0964909314e0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot 657d810e-2ce7-48fa-a367-0964909314e0 of volume 7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5b0ae1-6f89-4e8c-b204-a474c8de6b54]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:37 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 Jul 29 16:24:37 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:37 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 1G" returned: 0 in 0.555s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd40aed-7596-47a5-ac27-be9d110c6ede -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:37 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2" returned: 0 in 0.503s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:37 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd40aed-7596-47a5-ac27-be9d110c6ede -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 Jul 29 16:24:37 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:37 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2 Jul 29 16:24:37 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:37 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0" returned: 0 in 0.472s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:37 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1be536-52a2-4af7-8c69-3dd9b7c6a40c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-af01a15b-ce5b-401b-b6ec-938c316196b2" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd40aed-7596-47a5-ac27-be9d110c6ede -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 is being set with open permissions: ugo+rw Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-quobyte-af01a15b-ce5b-401b-b6ec-938c316196b2" released by "delete_volume" :: held 0.920s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:38 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 Jul 29 16:24:38 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Created reservations ['88300c09-cf02-4f4f-9b3c-5b61fbbe91c8', '4f75e45a-9f96-413a-99b9-f898f171916f', 'b42055a6-7630-437d-8acb-d6c3f747eb74', '89b0edab-6c6d-4512-8874-d70e486dc4b9'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:38 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 Jul 29 16:24:38 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:38 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:38 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525" returned: 0 in 0.389s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" returned: 0 in 0.439s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:38 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info Jul 29 16:24:38 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:38 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Deleted volume successfully. Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-418f1f78-fc02-4e5c-bcb8-caeced20e3c6 tempest-SnapshotDependencyTests-1334811284 None] Lock "cinder-af01a15b-ce5b-401b-b6ec-938c316196b2-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:38 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info" returned: 0 in 0.369s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info is being set with open permissions: ugo+rw Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0" returned: 0 in 0.427s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:38 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info Jul 29 16:24:38 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:38 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0 Jul 29 16:24:38 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:39 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.info" returned: 0 in 0.292s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:39 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379.657d810e-2ce7-48fa-a367-0964909314e0" returned: 0 in 0.300s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:39 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-20e4904b-2af5-48d8-ad28-527459af7cbb tempest-ProjectReaderTests-504587999 None] Create snapshot completed successfully Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-657d810e-2ce7-48fa-a367-0964909314e0" released by "_delete_snapshot" :: held 1.802s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" released by "delete_snapshot" :: held 1.839s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Created reservations ['d0222945-aafc-4afc-82d2-c488ba5630a8', '971d74e0-44fb-4d11-b6d2-db31d20a2f98', 'a71a28ff-bb7c-4abd-9c2e-008e8202fc7b', 'b8ea7fb6-2d03-43aa-bdd3-44605ab12e15'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:39 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fede1117-3bea-4b54-806d-cb074aa6a580 tempest-ProjectMemberTests-345949226 None] Lock "cinder-657d810e-2ce7-48fa-a367-0964909314e0-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-bf9949ca-2f32-4b17-b964-f522f701b525-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Lock "cinder-bf9949ca-2f32-4b17-b964-f522f701b525-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-5dd40aed-7596-47a5-ac27-be9d110c6ede" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Lock "cinder-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-5dd40aed-7596-47a5-ac27-be9d110c6ede" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-bf9949ca-2f32-4b17-b964-f522f701b525" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bf9949ca-2f32-4b17-b964-f522f701b525" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Deleting offline snapshot bf9949ca-2f32-4b17-b964-f522f701b525 of volume 5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] snapshot_file for this snap is: volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f18635b-6ab8-493c-93fe-e3e0e5c8b73d]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[437fd2a0-6f8e-494c-b3dc-d5555446a643]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:39 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 Jul 29 16:24:39 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:40 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 Jul 29 16:24:40 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:40 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525" returned: 0 in 0.499s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd40aed-7596-47a5-ac27-be9d110c6ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be9254-7f1d-45a7-9951-60c87b1ff202]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:40 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" returned: 0 in 0.555s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:40 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379 Jul 29 16:24:40 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:40 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede Jul 29 16:24:40 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:40 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" returned: 0 in 0.393s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379" released by "delete_volume" :: held 1.033s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:40 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede" returned: 0 in 0.517s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:40 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 Jul 29 16:24:40 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Created reservations ['bcd79955-071d-4d94-b397-7ea381cf5db3', '4e8ef876-fb99-4bec-ae86-b1d32726d790', '8fbfce8d-2ebe-4b61-b90d-2ffc38fc8aea', '6141dee5-b2db-4e8b-8d3b-0065662cd8ae'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:41 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:41 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:41 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525" returned: 0 in 0.482s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:41 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525 Jul 29 16:24:41 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:41 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.319s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7b36f75f-a812-485e-be75-a1191cf2846a tempest-ProjectMemberTests-345949226 None] Lock "cinder-7cc90cd9-3999-4ccc-bb2c-90c6f3bb0379-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:41 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede.bf9949ca-2f32-4b17-b964-f522f701b525" returned: 0 in 0.367s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bf9949ca-2f32-4b17-b964-f522f701b525" released by "_delete_snapshot" :: held 2.037s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-5dd40aed-7596-47a5-ac27-be9d110c6ede" released by "delete_snapshot" :: held 2.073s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:41 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Created reservations ['c2e3f7f3-a9f4-46bf-8dc9-e433a7b153a8', 'e4bcc3f1-592b-4fa7-b789-876fd597da66', 'f50f5fe9-e5fb-4cf0-8ab8-0080e02b572d', 'ff8b9e9e-bb11-44f0-945c-1a78eeeedb39'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:41 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Delete snapshot completed successfully. Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-701b7171-edec-4b69-ac71-84f6e89aedf9 tempest-ProjectReaderTests-504587999 None] Lock "cinder-bf9949ca-2f32-4b17-b964-f522f701b525-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (ed2b56e7-85d2-46bb-956e-22afbe98a803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993993c4-a303-4f67-bb8a-ae4c84cc21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993993c4-a303-4f67-bb8a-ae4c84cc21ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681031654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6b905b-efa1-485c-b970-c36873a522d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:43Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1aee7c-8456-40c9-a5ef-95b0f5e49fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1aee7c-8456-40c9-a5ef-95b0f5e49fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7afd5fd-1457-4287-beec-83ac19013d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7afd5fd-1457-4287-beec-83ac19013d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa6b905b-efa1-485c-b970-c36873a522d2', 'volume_name': 'volume-aa6b905b-efa1-485c-b970-c36873a522d2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaf3fe5-b177-4816-88c9-69954eed7cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaf3fe5-b177-4816-88c9-69954eed7cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5152c4c-3297-4b8e-803a-9ae5f9625bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:42 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Volume aa6b905b-efa1-485c-b970-c36873a522d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa6b905b-efa1-485c-b970-c36873a522d2', 'volume_size': 1} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681031654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6b905b-efa1-485c-b970-c36873a522d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:43Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Creating volume aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:42 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:42 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 1073741824 Jul 29 16:24:42 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-5dd40aed-7596-47a5-ac27-be9d110c6ede-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Lock "cinder-5dd40aed-7596-47a5-ac27-be9d110c6ede-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-5dd40aed-7596-47a5-ac27-be9d110c6ede" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-5dd40aed-7596-47a5-ac27-be9d110c6ede" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c114197-fdf1-4717-966b-1d0a6731a442]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:43 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede Jul 29 16:24:43 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:43 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 1073741824" returned: 0 in 0.597s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:43 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 Jul 29 16:24:43 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:43 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede" returned: 0 in 0.601s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:43 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede Jul 29 16:24:43 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:43 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5152c4c-3297-4b8e-803a-9ae5f9625bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6b905b-efa1-485c-b970-c36873a522d2', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a77bbfe-32ba-46e6-ba73-f6751a335390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:43 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Volume volume-aa6b905b-efa1-485c-b970-c36873a522d2 (aa6b905b-efa1-485c-b970-c36873a522d2): created successfully Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a77bbfe-32ba-46e6-ba73-f6751a335390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (ed2b56e7-85d2-46bb-956e-22afbe98a803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:43 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-05e43da6-9294-44fc-a6c5-d751be288569 tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:24:43 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-5dd40aed-7596-47a5-ac27-be9d110c6ede" returned: 0 in 0.303s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-5dd40aed-7596-47a5-ac27-be9d110c6ede" released by "delete_volume" :: held 0.973s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Created reservations ['503accd1-71cd-4fda-85fd-d8e19b4fb1bd', '90b13865-b6d2-4ee9-9145-22ade757bfff', 'ef5cce83-5f1f-44e6-9626-2bd018a030aa', 'fd5bfe6c-853a-415e-b19a-acb2a3f66e11'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:44 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:44 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:44 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.350s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Deleted volume successfully. Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2042edd8-45cf-48fc-b171-29c60db21ea4 tempest-ProjectReaderTests-504587999 None] Lock "cinder-5dd40aed-7596-47a5-ac27-be9d110c6ede-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Creating offline snapshot 547b211c-3885-44b0-81e4-3d60b9642ae1 of volume aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d5082f-df34-4588-ae1e-b778b6dd5a28]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:45 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 Jul 29 16:24:45 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:45 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2" returned: 0 in 0.409s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:45 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 1G Jul 29 16:24:45 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:45 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:45 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (b943d88f-253f-4605-95db-f4cf8c64ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b613b0-7aee-4fc2-aa9c-a79f4a42964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 1G" returned: 0 in 0.691s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6b905b-efa1-485c-b970-c36873a522d2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b613b0-7aee-4fc2-aa9c-a79f4a42964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54699504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba45722-31e3-4eaa-8993-1c0728d75e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:46Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c6dbf3-9f1c-417f-8ad9-2d988c6ebf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c6dbf3-9f1c-417f-8ad9-2d988c6ebf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65408559-1503-43f1-9fba-2b014ac7b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:46 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6b905b-efa1-485c-b970-c36873a522d2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 Jul 29 16:24:46 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65408559-1503-43f1-9fba-2b014ac7b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba45722-31e3-4eaa-8993-1c0728d75e4b', 'volume_name': 'volume-bba45722-31e3-4eaa-8993-1c0728d75e4b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1753ba0b-61cd-4354-8b91-2d23901742c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1753ba0b-61cd-4354-8b91-2d23901742c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c1b0e5-1944-4b89-9d8a-5b3c8f89ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:46 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Volume bba45722-31e3-4eaa-8993-1c0728d75e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba45722-31e3-4eaa-8993-1c0728d75e4b', 'volume_size': 1} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:46 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6b905b-efa1-485c-b970-c36873a522d2 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1" returned: 0 in 0.473s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:46 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 is being set with open permissions: ugo+rw Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:46 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 Jul 29 16:24:46 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:46 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1" returned: 0 in 0.327s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:46 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info Jul 29 16:24:46 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:47 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info" returned: 0 in 0.276s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:47 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info is being set with open permissions: ugo+rw Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:47 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info Jul 29 16:24:47 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:47 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.info" returned: 0 in 0.290s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54699504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba45722-31e3-4eaa-8993-1c0728d75e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da05f871ee2b41db8373b57f1d4747fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:46Z,use_quota=True,user_id='c45c2d07624448c8ad3268d495a6386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Creating volume bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:47 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:47 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b 1073741824 Jul 29 16:24:47 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ea6d2d05-9829-4b3f-86ce-a4216a0e9492 tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:24:47 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-547b211c-3885-44b0-81e4-3d60b9642ae1-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-547b211c-3885-44b0-81e4-3d60b9642ae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-aa6b905b-efa1-485c-b970-c36873a522d2" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-aa6b905b-efa1-485c-b970-c36873a522d2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-547b211c-3885-44b0-81e4-3d60b9642ae1" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-547b211c-3885-44b0-81e4-3d60b9642ae1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot 547b211c-3885-44b0-81e4-3d60b9642ae1 of volume aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[1069ca01-051c-47c1-ad08-053f733b27da]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:48 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b 1073741824" returned: 0 in 0.678s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:48 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b Jul 29 16:24:48 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:48 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 Jul 29 16:24:48 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:48 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b" returned: 0 in 0.336s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c1b0e5-1944-4b89-9d8a-5b3c8f89ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba45722-31e3-4eaa-8993-1c0728d75e4b', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d631c75a-23a8-4083-89df-b810151c3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:48 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Volume volume-bba45722-31e3-4eaa-8993-1c0728d75e4b (bba45722-31e3-4eaa-8993-1c0728d75e4b): created successfully Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d631c75a-23a8-4083-89df-b810151c3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Flow 'volume_create_manager' (b943d88f-253f-4605-95db-f4cf8c64ec64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:48 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f6a8f324-fcad-4ea6-9661-d6da019981a3 tempest-ProjectReaderTests-504587999 None] Created volume successfully. Jul 29 16:24:48 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1" returned: 0 in 0.543s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6b905b-efa1-485c-b970-c36873a522d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866956d-19fc-42e0-8fd9-bfd9b5d2770c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:48 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 Jul 29 16:24:48 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:49 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2" returned: 0 in 0.518s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:49 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 Jul 29 16:24:49 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Creating offline snapshot bf123874-6ad3-4846-a568-413d36312663 of volume bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[044455de-fc02-4ff0-8a5e-52e958148323]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:49 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b Jul 29 16:24:49 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:49 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1" returned: 0 in 0.556s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:49 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1 Jul 29 16:24:49 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:50 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b" returned: 0 in 0.556s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:50 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 1G Jul 29 16:24:50 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:50 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2.547b211c-3885-44b0-81e4-3d60b9642ae1" returned: 0 in 0.399s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-547b211c-3885-44b0-81e4-3d60b9642ae1" released by "_delete_snapshot" :: held 2.219s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-aa6b905b-efa1-485c-b970-c36873a522d2" released by "delete_snapshot" :: held 2.258s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Created reservations ['2890ea9e-562d-4293-8a13-89f33eb02b06', '07a544e6-6b0a-45f3-ac6d-b65284b667e1', '906f254c-863e-4344-a4c4-d1e410ff1119', '9a6591e6-9a94-4b13-9352-a283e98f620e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:50 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-8d70a544-7c44-487d-8a2b-364a1ef7ffa3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-547b211c-3885-44b0-81e4-3d60b9642ae1-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:50 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 1G" returned: 0 in 0.640s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba45722-31e3-4eaa-8993-1c0728d75e4b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:50 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba45722-31e3-4eaa-8993-1c0728d75e4b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 Jul 29 16:24:50 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:51 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba45722-31e3-4eaa-8993-1c0728d75e4b -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663" returned: 0 in 0.335s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:51 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 is being set with open permissions: ugo+rw Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:51 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 Jul 29 16:24:51 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-aa6b905b-efa1-485c-b970-c36873a522d2-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:51 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663" returned: 0 in 0.498s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Lock "cinder-aa6b905b-efa1-485c-b970-c36873a522d2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:51 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info Jul 29 16:24:51 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-aa6b905b-efa1-485c-b970-c36873a522d2" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-aa6b905b-efa1-485c-b970-c36873a522d2" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d30d8-9eb2-4e8a-825b-779ee3eb95c9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:51 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 Jul 29 16:24:51 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:51 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info" returned: 0 in 0.334s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:51 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info is being set with open permissions: ugo+rw Jul 29 16:24:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:51 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info Jul 29 16:24:51 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:52 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2" returned: 0 in 0.465s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:52 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2 Jul 29 16:24:52 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:52 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.info" returned: 0 in 0.313s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-bbb4e36d-4333-4699-a8df-8ffafc059a3e tempest-ProjectReaderTests-504587999 None] Create snapshot completed successfully Jul 29 16:24:52 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-aa6b905b-efa1-485c-b970-c36873a522d2" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-aa6b905b-efa1-485c-b970-c36873a522d2" released by "delete_volume" :: held 0.823s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Created reservations ['022182bf-15b1-458c-8800-f093bda87996', 'a437c203-9be4-4c67-947b-75c1c42612f9', 'dfe98fb4-a7da-4983-82ea-3e822bbf7b5d', 'c04a1e1c-34fc-40da-bda0-eae722887d79'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:52 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:52 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-bf123874-6ad3-4846-a568-413d36312663-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Lock "cinder-bf123874-6ad3-4846-a568-413d36312663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-bba45722-31e3-4eaa-8993-1c0728d75e4b" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bba45722-31e3-4eaa-8993-1c0728d75e4b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-bf123874-6ad3-4846-a568-413d36312663" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bf123874-6ad3-4846-a568-413d36312663" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Deleting offline snapshot bf123874-6ad3-4846-a568-413d36312663 of volume bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] snapshot_file for this snap is: volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[06966411-5836-44c4-aa41-427f3625478c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:52 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:52 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:52 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 Jul 29 16:24:52 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:52 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-320853bc-b8b9-41d2-bc03-30ab2e6a88ae tempest-ProjectMemberTests-345949226 None] Lock "cinder-aa6b905b-efa1-485c-b970-c36873a522d2-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:53 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663" returned: 0 in 0.482s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba45722-31e3-4eaa-8993-1c0728d75e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[134ff55f-c1be-4fe4-85b4-32eb664288bc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (03699c8f-7970-4240-a2c9-2f204c9cb4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c208805-8deb-4e34-8328-bd0b723cec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c208805-8deb-4e34-8328-bd0b723cec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29436105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0437da7-cd9b-46c5-a01d-cc8f4f4c8434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:53Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b3a4b-e498-4f69-b285-ddbb35093075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b3a4b-e498-4f69-b285-ddbb35093075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bac626b-ccd7-4cd7-8a1c-99686988958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:53 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bac626b-ccd7-4cd7-8a1c-99686988958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0437da7-cd9b-46c5-a01d-cc8f4f4c8434', 'volume_name': 'volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:53 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d383cb14-df06-432f-867b-484cca445e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d383cb14-df06-432f-867b-484cca445e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354d12fa-511a-4852-bae3-055fc492d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:53 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Volume d0437da7-cd9b-46c5-a01d-cc8f4f4c8434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434', 'volume_size': 1} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29436105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0437da7-cd9b-46c5-a01d-cc8f4f4c8434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:24:53Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Creating volume d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:24:53 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:53 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 1073741824 Jul 29 16:24:53 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:53 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b" returned: 0 in 0.439s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:53 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 Jul 29 16:24:53 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:53 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:53 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 1073741824" returned: 0 in 0.505s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:54 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 Jul 29 16:24:54 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:54 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663" returned: 0 in 0.460s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:54 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663 Jul 29 16:24:54 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:54 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" returned: 0 in 0.333s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354d12fa-511a-4852-bae3-055fc492d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3870bd04-1ee6-41b8-8f58-877f8bf670d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:24:54 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Volume volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 (d0437da7-cd9b-46c5-a01d-cc8f4f4c8434): created successfully Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3870bd04-1ee6-41b8-8f58-877f8bf670d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (03699c8f-7970-4240-a2c9-2f204c9cb4ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:24:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-8be898d8-fb45-4edd-8e8e-7c33b5f0bf4a tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:24:54 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b.bf123874-6ad3-4846-a568-413d36312663" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bf123874-6ad3-4846-a568-413d36312663" released by "_delete_snapshot" :: held 1.806s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bba45722-31e3-4eaa-8993-1c0728d75e4b" released by "delete_snapshot" :: held 1.836s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Created reservations ['c198ace3-51a2-4d81-8666-29fd273ede7d', 'fa071336-1ab2-4871-a267-bacf0c3dd5ec', '35e82b5c-de25-4c6d-b9ee-9f7f1bb23739', '1a92ea6a-2705-42fd-aa7a-82c6ffca5c0e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:54 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Delete snapshot completed successfully. Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-e43f1369-e79d-4f58-aab4-5886169f773b tempest-ProjectReaderTests-504587999 None] Lock "cinder-bf123874-6ad3-4846-a568-413d36312663-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-bba45722-31e3-4eaa-8993-1c0728d75e4b-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Lock "cinder-bba45722-31e3-4eaa-8993-1c0728d75e4b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Acquiring lock "cinder-quobyte-bba45722-31e3-4eaa-8993-1c0728d75e4b" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bba45722-31e3-4eaa-8993-1c0728d75e4b" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20be5ce-bfbf-4b51-bd3d-95a9f584e8e3]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:54 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:55 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b Jul 29 16:24:55 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:55 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b" returned: 0 in 0.383s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:55 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b Jul 29 16:24:55 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:55 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-bba45722-31e3-4eaa-8993-1c0728d75e4b" returned: 0 in 0.332s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Creating offline snapshot ad5afd82-d997-42be-aa29-b349b42e82e7 of volume d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442418b-8447-4a3b-b0cc-d3d638f7b4e8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Lock "cinder-quobyte-bba45722-31e3-4eaa-8993-1c0728d75e4b" released by "delete_volume" :: held 0.795s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Created reservations ['3bb2b629-2c9a-4ff3-9199-213ed166016c', '7e4dbe4e-162d-41db-8146-40821e5d09b8', '7d7268a8-5237-455f-a5b3-a12beb31bd65', 'e2b56e85-cf56-42c4-958f-3aa779385b62'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:24:55 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 Jul 29 16:24:55 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:55 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:55 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:24:55 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:56 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" returned: 0 in 0.457s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:56 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.329s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:24:56 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 1G Jul 29 16:24:56 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:56 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Deleted volume successfully. Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-03ac1d0b-5576-4113-b51e-465dfe529282 tempest-ProjectReaderTests-504587999 None] Lock "cinder-bba45722-31e3-4eaa-8993-1c0728d75e4b-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:24:56 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 1G" returned: 0 in 0.553s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:56 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:56 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 Jul 29 16:24:56 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:57 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7" returned: 0 in 0.302s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:57 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 is being set with open permissions: ugo+rw Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:57 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 Jul 29 16:24:57 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:57 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7" returned: 0 in 0.278s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:57 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info Jul 29 16:24:57 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:57 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info" returned: 0 in 0.330s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:57 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info is being set with open permissions: ugo+rw Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:57 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info Jul 29 16:24:57 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:57 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.info" returned: 0 in 0.318s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:57 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:24:58 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-6727ecbe-a1d4-4b16-93dc-e83c23847693 tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-ad5afd82-d997-42be-aa29-b349b42e82e7-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-ad5afd82-d997-42be-aa29-b349b42e82e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-ad5afd82-d997-42be-aa29-b349b42e82e7" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-ad5afd82-d997-42be-aa29-b349b42e82e7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot ad5afd82-d997-42be-aa29-b349b42e82e7 of volume d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e50d7-9582-4c6a-aff1-03c2a9d4a043]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:58 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:59 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 Jul 29 16:24:59 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:59 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7" returned: 0 in 0.461s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:59 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:24:59 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[388218fc-e33c-4bca-8fe5-2a7ac20010bd]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:24:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:59 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 Jul 29 16:24:59 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:24:59 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 29 16:24:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" returned: 0 in 0.481s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:24:59 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:24:59 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 Jul 29 16:24:59 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:00 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:00 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7 Jul 29 16:25:00 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:00 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434.ad5afd82-d997-42be-aa29-b349b42e82e7" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-ad5afd82-d997-42be-aa29-b349b42e82e7" released by "_delete_snapshot" :: held 1.738s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" released by "delete_snapshot" :: held 1.770s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Created reservations ['9b8f07ad-4c09-472c-b28b-fa82665138d2', 'f96190f7-8097-4b73-9659-7c4efc6ded76', '410ce18f-4893-4c30-9c56-c5f995f6029d', '20e57307-9ba9-49bf-bc46-14f76db080e8'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:00 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-876ff277-6bd4-479b-af71-be80b6d275a3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-ad5afd82-d997-42be-aa29-b349b42e82e7-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Flow 'volume_create_manager' (2570a841-edad-4d05-81b2-9a64c6ce5405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:00 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7b96bb-f77a-4ea5-a941-6a3c191703a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7b96bb-f77a-4ea5-a941-6a3c191703a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563273946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c5b29d-3690-4998-8823-4b42d0876d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='498507f18042490d8cffecff261adeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:01Z,use_quota=True,user_id='d837e44d8afc49c4b9d395417bbbfb87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66b9ce9-cb0e-47a4-807c-6fa8815f6df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66b9ce9-cb0e-47a4-807c-6fa8815f6df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db438165-131d-4e22-8257-6b4fd0e06cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db438165-131d-4e22-8257-6b4fd0e06cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c5b29d-3690-4998-8823-4b42d0876d11', 'volume_name': 'volume-a2c5b29d-3690-4998-8823-4b42d0876d11', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26cac59-dbd5-43da-b93b-bf9ea7198c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26cac59-dbd5-43da-b93b-bf9ea7198c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215d394-4317-41a8-bf72-17e17413cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Volume a2c5b29d-3690-4998-8823-4b42d0876d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c5b29d-3690-4998-8823-4b42d0876d11', 'volume_size': 1} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563273946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c5b29d-3690-4998-8823-4b42d0876d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='498507f18042490d8cffecff261adeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:01Z,use_quota=True,user_id='d837e44d8afc49c4b9d395417bbbfb87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Creating volume a2c5b29d-3690-4998-8823-4b42d0876d11 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:01 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:01 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 1073741824 Jul 29 16:25:01 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Lock "cinder-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" acquired by "delete_volume" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f679b8e-8d3d-4211-a1a9-11a32940b6cc]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:01 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 Jul 29 16:25:01 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:01 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 1073741824" returned: 0 in 0.536s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:01 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" returned: 0 in 0.425s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:01 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434 Jul 29 16:25:01 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:01 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 Jul 29 16:25:01 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:01 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11" returned: 0 in 0.271s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215d394-4317-41a8-bf72-17e17413cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c5b29d-3690-4998-8823-4b42d0876d11', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6410b7a3-df4c-40dc-adfc-b4c94582b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:01 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" returned: 0 in 0.314s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434" released by "delete_volume" :: held 0.809s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:01 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Volume volume-a2c5b29d-3690-4998-8823-4b42d0876d11 (a2c5b29d-3690-4998-8823-4b42d0876d11): created successfully Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6410b7a3-df4c-40dc-adfc-b4c94582b802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Flow 'volume_create_manager' (2570a841-edad-4d05-81b2-9a64c6ce5405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=230,cinder:SELECT=183,cinder:INSERT=58,cinder:DELETE=15 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:25:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-50e6cb45-4019-41e1-9fb5-6132a730fabe tempest-ProjectReaderTests-992115834 None] Created volume successfully. Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Created reservations ['7f2322e4-4d24-4db5-bdbd-a717b868c91a', '962d0fca-de45-42a4-bcbf-4b4657884d58', '75678f54-7a6d-43f3-80db-efe78144966c', '97c23c11-4b4e-4087-9bf0-970cefefa048'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:02 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:02 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:02 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.282s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:02 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-71159c09-8642-4a56-826c-0faa748a68a8 tempest-ProjectMemberTests-345949226 None] Lock "cinder-d0437da7-cd9b-46c5-a01d-cc8f4f4c8434-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (e17f464a-b394-4854-a1a2-2afbc399576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44764f7-e5c5-4f0c-b70b-8a98b68dde25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44764f7-e5c5-4f0c-b70b-8a98b68dde25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023027415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a12659-ffdc-4e89-bc8c-1247bfec73a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:03Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834f01e2-95a3-46bb-bb56-d34559903687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834f01e2-95a3-46bb-bb56-d34559903687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e6e55e-85ed-4069-98e6-26c2f9a9cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e6e55e-85ed-4069-98e6-26c2f9a9cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a12659-ffdc-4e89-bc8c-1247bfec73a8', 'volume_name': 'volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c657cb-1847-4a24-af10-3e623c0b1f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c657cb-1847-4a24-af10-3e623c0b1f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6908e80e-8e32-407d-90f7-b01fb960accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:02 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Volume 11a12659-ffdc-4e89-bc8c-1247bfec73a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8', 'volume_size': 1} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023027415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a12659-ffdc-4e89-bc8c-1247bfec73a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:03Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Creating volume 11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:02 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:02 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:02 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 1073741824 Jul 29 16:25:02 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:03 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 1073741824" returned: 0 in 0.467s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Acquiring lock "cinder-a2c5b29d-3690-4998-8823-4b42d0876d11-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Lock "cinder-a2c5b29d-3690-4998-8823-4b42d0876d11-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:03 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 Jul 29 16:25:03 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Acquiring lock "cinder-quobyte-a2c5b29d-3690-4998-8823-4b42d0876d11" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Lock "cinder-quobyte-a2c5b29d-3690-4998-8823-4b42d0876d11" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c252477e-0507-4855-9597-a841a7484b27]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:03 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 Jul 29 16:25:03 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:03 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8" returned: 0 in 0.316s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6908e80e-8e32-407d-90f7-b01fb960accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2457bd-6ad1-499d-8527-e21d3f9c7200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:03 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Volume volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 (11a12659-ffdc-4e89-bc8c-1247bfec73a8): created successfully Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2457bd-6ad1-499d-8527-e21d3f9c7200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (e17f464a-b394-4854-a1a2-2afbc399576c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:03 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ce9e7ef1-23d3-4ba7-b3aa-7813162f47a6 tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:25:03 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:03 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:03 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11 Jul 29 16:25:03 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:04 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-a2c5b29d-3690-4998-8823-4b42d0876d11" returned: 0 in 0.244s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Lock "cinder-quobyte-a2c5b29d-3690-4998-8823-4b42d0876d11" released by "delete_volume" :: held 0.690s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Created reservations ['33fb9b36-3e42-4935-bb70-e26704e7b9ea', '8410b6d1-4e32-4566-a832-828efccdfd20', 'fb1ca617-4b3b-4e26-a145-57e5a1131b34', '5dc75571-58a3-4980-86fd-829ca8da3298'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:04 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:04 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:04 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:04 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Deleted volume successfully. Jul 29 16:25:04 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-4c6f8147-ebc3-473f-bf4d-beb2531b0410 tempest-ProjectReaderTests-992115834 None] Lock "cinder-a2c5b29d-3690-4998-8823-4b42d0876d11-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Flow 'volume_create_manager' (e69d41f4-2758-4578-ace2-6393c0dac430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a4ac4-a7cd-413b-a2cb-aa3b9d871f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Creating offline snapshot fd7fb19a-a373-4d49-ad61-cc6c2494abbe of volume 11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a4ac4-a7cd-413b-a2cb-aa3b9d871f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370194207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbd64a6-71e9-4d6b-80bc-37ce3bbe3755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='498507f18042490d8cffecff261adeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:05Z,use_quota=True,user_id='d837e44d8afc49c4b9d395417bbbfb87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83450160-8012-4b4f-b51c-aa3c025274e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83450160-8012-4b4f-b51c-aa3c025274e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10295c93-c0e0-463d-8cf7-3fb7056af78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10295c93-c0e0-463d-8cf7-3fb7056af78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbd64a6-71e9-4d6b-80bc-37ce3bbe3755', 'volume_name': 'volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61146bde-44bf-4da1-9f59-b20904e19550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61146bde-44bf-4da1-9f59-b20904e19550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c3ab13-6ee9-4d3e-8578-775f5486f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:05 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Volume afbd64a6-71e9-4d6b-80bc-37ce3bbe3755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755', 'volume_size': 1} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[88479c57-5ca1-4fa1-b9e2-f1a2798eaf0c]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:05 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 Jul 29 16:25:05 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:05 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8" returned: 0 in 0.386s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:05 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe 1G Jul 29 16:25:05 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:05 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe 1G" returned: 0 in 0.425s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:05 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:06 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe Jul 29 16:25:06 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:06 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe" returned: 0 in 0.291s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:06 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe is being set with open permissions: ugo+rw Jul 29 16:25:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:06 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe Jul 29 16:25:06 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:06 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:06 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info Jul 29 16:25:06 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:06 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info" returned: 0 in 0.272s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:06 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info is being set with open permissions: ugo+rw Jul 29 16:25:06 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:06 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info Jul 29 16:25:06 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:07 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.info" returned: 0 in 0.268s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.940s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370194207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbd64a6-71e9-4d6b-80bc-37ce3bbe3755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='498507f18042490d8cffecff261adeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:05Z,use_quota=True,user_id='d837e44d8afc49c4b9d395417bbbfb87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Creating volume afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:07 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:07 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 1073741824 Jul 29 16:25:07 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2dcdbc44-91d4-44da-96cc-2ec895042812 tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:25:07 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 1073741824" returned: 0 in 0.444s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:07 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 Jul 29 16:25:07 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:07 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c3ab13-6ee9-4d3e-8578-775f5486f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0742dd1e-c7dc-4c3d-b9d2-82407fc8157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:07 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Volume volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 (afbd64a6-71e9-4d6b-80bc-37ce3bbe3755): created successfully Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0742dd1e-c7dc-4c3d-b9d2-82407fc8157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:07 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Flow 'volume_create_manager' (e69d41f4-2758-4578-ace2-6393c0dac430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:07 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-89b9c1d6-edd4-4266-8bcf-59d437640789 tempest-ProjectReaderTests-992115834 None] Created volume successfully. Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-fd7fb19a-a373-4d49-ad61-cc6c2494abbe-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Lock "cinder-fd7fb19a-a373-4d49-ad61-cc6c2494abbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-11a12659-ffdc-4e89-bc8c-1247bfec73a8" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Acquiring lock "cinder-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-11a12659-ffdc-4e89-bc8c-1247bfec73a8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-fd7fb19a-a373-4d49-ad61-cc6c2494abbe" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Lock "cinder-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-fd7fb19a-a373-4d49-ad61-cc6c2494abbe" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot fd7fb19a-a373-4d49-ad61-cc6c2494abbe of volume 11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49c936-14ea-4672-bca8-d7ec45a7fc9f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Acquiring lock "cinder-quobyte-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Lock "cinder-quobyte-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fbe1e1-573e-4b8d-873b-aaf77332f9e8]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:08 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe Jul 29 16:25:08 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:08 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 Jul 29 16:25:08 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:08 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe" returned: 0 in 0.378s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea21f6-febe-4113-84d3-820d937c93c5]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:08 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:08 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755 Jul 29 16:25:08 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:08 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 Jul 29 16:25:08 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:08 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:08 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755" returned: 0 in 0.254s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Lock "cinder-quobyte-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755" released by "delete_volume" :: held 0.682s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:09 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8" returned: 0 in 0.397s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Created reservations ['729eef4b-c733-4622-ae95-10c7e03f1246', '19e1640d-a45c-4cdb-a604-b9f3b8de2acd', 'f7014a72-e95b-4f26-a340-33f5204ed94d', 'f501eb19-9f7a-4ac7-8bd7-5fcfb4088c6e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:09 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe Jul 29 16:25:09 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:09 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:09 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:09 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:09 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Deleted volume successfully. Jul 29 16:25:09 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe Jul 29 16:25:09 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3d108f17-e806-4f76-8f63-f50fae662b54 tempest-ProjectReaderTests-992115834 None] Lock "cinder-afbd64a6-71e9-4d6b-80bc-37ce3bbe3755-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:09 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8.fd7fb19a-a373-4d49-ad61-cc6c2494abbe" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-fd7fb19a-a373-4d49-ad61-cc6c2494abbe" released by "_delete_snapshot" :: held 1.566s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-11a12659-ffdc-4e89-bc8c-1247bfec73a8" released by "delete_snapshot" :: held 1.606s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Created reservations ['ed8406c5-ff9f-4fca-b833-aac6c7d2e32d', '4d0ac55f-a896-43bc-beb4-a774072e3108', '6308ef13-f395-43c2-b1d7-ac3570f46abb', 'b9471940-7189-41d8-9e0f-333699eba7b3'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:09 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:09 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-00892987-cde4-47f7-a7b9-2f4f874e99ad tempest-ProjectMemberTests-345949226 None] Lock "cinder-fd7fb19a-a373-4d49-ad61-cc6c2494abbe-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-11a12659-ffdc-4e89-bc8c-1247bfec73a8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-11a12659-ffdc-4e89-bc8c-1247bfec73a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-11a12659-ffdc-4e89-bc8c-1247bfec73a8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-11a12659-ffdc-4e89-bc8c-1247bfec73a8" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8ca06d-ef7d-4d51-b838-3a33941e61b2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:10 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 Jul 29 16:25:10 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:10 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8" returned: 0 in 0.427s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:10 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:10 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8 Jul 29 16:25:10 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:11 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-11a12659-ffdc-4e89-bc8c-1247bfec73a8" returned: 0 in 0.291s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-11a12659-ffdc-4e89-bc8c-1247bfec73a8" released by "delete_volume" :: held 0.810s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Created reservations ['355b4a8a-9ad7-446e-8f5b-92e6dc5e8296', '73cdb94b-f109-42e7-919f-21f298af35d1', 'ee2d50a2-e78f-4ecb-bf80-22d1896ab9a6', '87d60345-21a0-4955-a198-9569ad5ad3db'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:11 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:11 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:11 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.288s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:11 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a7339c0f-e53e-44cc-b6e3-c166a67cd0d3 tempest-ProjectMemberTests-345949226 None] Lock "cinder-11a12659-ffdc-4e89-bc8c-1247bfec73a8-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:11 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=166,cinder:INSERT=67,cinder:UPDATE=216,cinder:DELETE=21 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (38700f90-4a41-41b5-8720-a4586a27a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aafec15-c5d9-4e2d-90eb-8d151a8c7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aafec15-c5d9-4e2d-90eb-8d151a8c7431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649544718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2c0b05-bb65-4e95-8a14-60d8230571f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:12Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9e5e3b-3ce3-4075-b93f-9de9f47cff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9e5e3b-3ce3-4075-b93f-9de9f47cff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1aa31b7-5fee-47f2-b7ed-435648c9c38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1aa31b7-5fee-47f2-b7ed-435648c9c38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2c0b05-bb65-4e95-8a14-60d8230571f4', 'volume_name': 'volume-db2c0b05-bb65-4e95-8a14-60d8230571f4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4b46e6-d0d6-4789-abfc-b0e8d154c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4b46e6-d0d6-4789-abfc-b0e8d154c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf854e82-f208-4f3c-840d-5ff283d7bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Volume db2c0b05-bb65-4e95-8a14-60d8230571f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2c0b05-bb65-4e95-8a14-60d8230571f4', 'volume_size': 1} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649544718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2c0b05-bb65-4e95-8a14-60d8230571f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:12Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Creating volume db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:12 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:12 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 1073741824 Jul 29 16:25:12 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:12 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 1073741824" returned: 0 in 0.495s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:12 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 Jul 29 16:25:12 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:12 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4" returned: 0 in 0.260s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf854e82-f208-4f3c-840d-5ff283d7bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2c0b05-bb65-4e95-8a14-60d8230571f4', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095d6cd2-8620-4c30-b1e5-e781232ec920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:12 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Volume volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 (db2c0b05-bb65-4e95-8a14-60d8230571f4): created successfully Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095d6cd2-8620-4c30-b1e5-e781232ec920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:12 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (38700f90-4a41-41b5-8720-a4586a27a300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:12 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-413bb6b7-8e56-46c7-a28b-fff3168cfc6a tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (65371903-2f2b-4d54-843e-efcd87217d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9be6773-2c12-49e6-ae9d-a319d05f17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9be6773-2c12-49e6-ae9d-a319d05f17c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2008987197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4598f718-e945-4174-820a-18ae688513d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:14Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffa3d9e-4a17-4853-9256-25ea26c72635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffa3d9e-4a17-4853-9256-25ea26c72635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78033524-8fe6-4e3b-b7af-5a6f0c864588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78033524-8fe6-4e3b-b7af-5a6f0c864588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4598f718-e945-4174-820a-18ae688513d3', 'volume_name': 'volume-4598f718-e945-4174-820a-18ae688513d3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454c8132-5ace-425e-adaf-dcd0138de4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454c8132-5ace-425e-adaf-dcd0138de4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73b5c97-e93b-4de9-a83b-3153340354c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:13 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Volume 4598f718-e945-4174-820a-18ae688513d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4598f718-e945-4174-820a-18ae688513d3', 'volume_size': 1} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2008987197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4598f718-e945-4174-820a-18ae688513d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:14Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Creating volume 4598f718-e945-4174-820a-18ae688513d3 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:13 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:13 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:13 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 1073741824 Jul 29 16:25:13 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:14 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 1073741824" returned: 0 in 0.442s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:14 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 Jul 29 16:25:14 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:14 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.157s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73b5c97-e93b-4de9-a83b-3153340354c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4598f718-e945-4174-820a-18ae688513d3', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4517f1e8-66bc-4cd2-974b-1c6cb98f4ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Creating offline snapshot 42adeb2a-f165-457d-a1c6-925c53c3828c of volume db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:25:14 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Volume volume-4598f718-e945-4174-820a-18ae688513d3 (4598f718-e945-4174-820a-18ae688513d3): created successfully Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4517f1e8-66bc-4cd2-974b-1c6cb98f4ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (65371903-2f2b-4d54-843e-efcd87217d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b851e6b-91fd-4dd3-bb3c-fc5ac3759687]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:14 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fb029025-ab41-447d-9ed1-62f440c0c731 tempest-ProjectReaderTests-978668240 None] Created volume successfully. Jul 29 16:25:14 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 Jul 29 16:25:14 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:14 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4" returned: 0 in 0.357s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:14 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:14 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c 1G Jul 29 16:25:14 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:15 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c 1G" returned: 0 in 0.388s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:15 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c Jul 29 16:25:15 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:15 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c" returned: 0 in 0.275s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:15 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c is being set with open permissions: ugo+rw Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:15 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c Jul 29 16:25:15 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:15 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c" returned: 0 in 0.240s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-4598f718-e945-4174-820a-18ae688513d3-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Lock "cinder-4598f718-e945-4174-820a-18ae688513d3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:15 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info Jul 29 16:25:15 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-quobyte-4598f718-e945-4174-820a-18ae688513d3" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-4598f718-e945-4174-820a-18ae688513d3" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b54e264-5e29-4231-83b4-bd7ed0d1b612]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:15 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:16 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 Jul 29 16:25:16 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:16 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:16 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info is being set with open permissions: ugo+rw Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:16 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info Jul 29 16:25:16 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:16 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3" returned: 0 in 0.381s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:16 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3 Jul 29 16:25:16 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:16 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.info" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9feab691-0e93-42c3-b36b-5c117b5f1399 tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:25:16 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-4598f718-e945-4174-820a-18ae688513d3" returned: 0 in 0.261s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-4598f718-e945-4174-820a-18ae688513d3" released by "delete_volume" :: held 0.692s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Created reservations ['f3dcb225-ac8e-4d4e-9bfc-f2c37d62c3aa', '27eaf176-3afe-4cbf-9c9c-833053771277', '528fe3f3-b481-4f5f-9ea2-27a9c625745c', 'ea9f268f-1558-4971-a4b1-2e9043670c82'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:16 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:16 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:16 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.248s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:16 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Deleted volume successfully. Jul 29 16:25:16 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5340e26f-dc67-4be9-8bd6-4e1100ceb8dc tempest-ProjectReaderTests-978668240 None] Lock "cinder-4598f718-e945-4174-820a-18ae688513d3-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (77f1c2f4-7c3f-4fb3-ae2d-da561e2524be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96dc140-ee89-449e-9349-3e2cb2f68caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96dc140-ee89-449e-9349-3e2cb2f68caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1228394642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d582f4c1-a6ba-43ab-815f-6bd0549e39db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:17Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3687e4-80ac-4f74-8b9d-62ab6b1080b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3687e4-80ac-4f74-8b9d-62ab6b1080b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caeed5a0-50ef-4102-bddd-5a3706c138bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caeed5a0-50ef-4102-bddd-5a3706c138bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd582f4c1-a6ba-43ab-815f-6bd0549e39db', 'volume_name': 'volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96acb319-696d-4dac-97a6-47e241edb628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96acb319-696d-4dac-97a6-47e241edb628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b129399a-e329-4a5d-9847-4b2a87d63134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:17 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Volume d582f4c1-a6ba-43ab-815f-6bd0549e39db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db', 'volume_size': 1} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1228394642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d582f4c1-a6ba-43ab-815f-6bd0549e39db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:17Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Creating volume d582f4c1-a6ba-43ab-815f-6bd0549e39db {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:17 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-42adeb2a-f165-457d-a1c6-925c53c3828c-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:17 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db 1073741824 Jul 29 16:25:17 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Lock "cinder-42adeb2a-f165-457d-a1c6-925c53c3828c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-db2c0b05-bb65-4e95-8a14-60d8230571f4" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-db2c0b05-bb65-4e95-8a14-60d8230571f4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-42adeb2a-f165-457d-a1c6-925c53c3828c" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-42adeb2a-f165-457d-a1c6-925c53c3828c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot 42adeb2a-f165-457d-a1c6-925c53c3828c of volume db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306a011-f1c6-4cb7-bf5e-6fb14f7a2422]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:17 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c Jul 29 16:25:17 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:17 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db 1073741824" returned: 0 in 0.447s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:17 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c" returned: 0 in 0.380s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:17 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2c0b05-bb65-4e95-8a14-60d8230571f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d79cd32-6d8a-4894-b499-c050bf37a2c4]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:18 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db Jul 29 16:25:18 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:18 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 Jul 29 16:25:18 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:18 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b129399a-e329-4a5d-9847-4b2a87d63134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4458173-9274-4382-845b-936fe37c5931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:18 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Volume volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db (d582f4c1-a6ba-43ab-815f-6bd0549e39db): created successfully Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4458173-9274-4382-845b-936fe37c5931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (77f1c2f4-7c3f-4fb3-ae2d-da561e2524be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:18 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f1068579-2bdb-4269-a295-8298d8993ca4 tempest-ProjectReaderTests-978668240 None] Created volume successfully. Jul 29 16:25:18 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4" returned: 0 in 0.426s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:18 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c Jul 29 16:25:18 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:18 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c" returned: 0 in 0.332s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:18 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:18 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c Jul 29 16:25:18 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:19 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4.42adeb2a-f165-457d-a1c6-925c53c3828c" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-42adeb2a-f165-457d-a1c6-925c53c3828c" released by "_delete_snapshot" :: held 1.499s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-db2c0b05-bb65-4e95-8a14-60d8230571f4" released by "delete_snapshot" :: held 1.521s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Created reservations ['5803465e-6399-43ef-badc-918422bd39ae', '1ce2dae8-6e25-4eaa-afc2-55d4911ca20c', 'f99f1a6d-5e91-4f0f-9ee4-bc1603c5f0a3', '8944f4ae-054b-4380-b2ab-fa73c5e6ab14'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:19 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-cf2e4bb8-f66f-44c8-969f-09d4d9a7c122 tempest-ProjectMemberTests-345949226 None] Lock "cinder-42adeb2a-f165-457d-a1c6-925c53c3828c-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-d582f4c1-a6ba-43ab-815f-6bd0549e39db-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Lock "cinder-d582f4c1-a6ba-43ab-815f-6bd0549e39db-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-quobyte-d582f4c1-a6ba-43ab-815f-6bd0549e39db" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-d582f4c1-a6ba-43ab-815f-6bd0549e39db" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ee098-d65b-4fa5-9836-016beae3902b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-db2c0b05-bb65-4e95-8a14-60d8230571f4-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Lock "cinder-db2c0b05-bb65-4e95-8a14-60d8230571f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-db2c0b05-bb65-4e95-8a14-60d8230571f4" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-db2c0b05-bb65-4e95-8a14-60d8230571f4" acquired by "delete_volume" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2da57b-be02-4d19-a79a-3c7b99642494]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:19 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:19 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db Jul 29 16:25:19 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:19 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 Jul 29 16:25:19 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:20 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db" returned: 0 in 0.391s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:20 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db Jul 29 16:25:20 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:20 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4" returned: 0 in 0.374s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:20 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4 Jul 29 16:25:20 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:20 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d582f4c1-a6ba-43ab-815f-6bd0549e39db" returned: 0 in 0.265s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-d582f4c1-a6ba-43ab-815f-6bd0549e39db" released by "delete_volume" :: held 0.699s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Created reservations ['d72c5217-b16c-4c14-ad5c-4bcecbd1e4d6', 'd981a8c8-8b53-4ecb-9d8e-2ee4b90d5027', '4e4bc038-58a2-4386-9a8c-065ace207529', '6cdf22e8-1c27-4df0-add9-692cd9186839'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:20 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-db2c0b05-bb65-4e95-8a14-60d8230571f4" returned: 0 in 0.267s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-db2c0b05-bb65-4e95-8a14-60d8230571f4" released by "delete_volume" :: held 0.707s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:20 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:20 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Created reservations ['a3586e17-6fd3-4488-9a53-3be69a916ea2', '2c52f7d8-7def-4355-a727-47670241d992', '9c297f5f-1b96-450e-8ad2-dff5949fa6fe', 'c70784da-3ad6-4606-9b29-6c20fc5b3e64'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:20 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:20 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:20 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Deleted volume successfully. Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-ee30a13d-6409-4e3c-834f-ef62a8735e09 tempest-ProjectReaderTests-978668240 None] Lock "cinder-d582f4c1-a6ba-43ab-815f-6bd0549e39db-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:20 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.286s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:20 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:20 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-a398c009-94fe-432a-a6b9-6e3006e24203 tempest-ProjectMemberTests-345949226 None] Lock "cinder-db2c0b05-bb65-4e95-8a14-60d8230571f4-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (540d2ca0-9a71-4807-a999-7a43a81c246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b065606e-4112-403d-bcf8-a6ec7db6743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (4f690fd6-1c67-4a90-8b78-b06d69dd0054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32eab605-bec3-453c-b09f-7a04f76e3dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b065606e-4112-403d-bcf8-a6ec7db6743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582630343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cbe856-e5ec-4cea-bc94-7071481a9c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:21Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9fd1a2-373b-4473-8be3-cbe21079d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9fd1a2-373b-4473-8be3-cbe21079d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26a7eef-a432-4267-876a-2daf9bfc2bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26a7eef-a432-4267-876a-2daf9bfc2bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cbe856-e5ec-4cea-bc94-7071481a9c75', 'volume_name': 'volume-68cbe856-e5ec-4cea-bc94-7071481a9c75', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b6f5ad-bf20-4041-a188-c58b309c06ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b6f5ad-bf20-4041-a188-c58b309c06ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3e4b05-3f8b-486a-9472-5f0c3aa83ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Volume 68cbe856-e5ec-4cea-bc94-7071481a9c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cbe856-e5ec-4cea-bc94-7071481a9c75', 'volume_size': 1} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582630343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cbe856-e5ec-4cea-bc94-7071481a9c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:21Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Creating volume 68cbe856-e5ec-4cea-bc94-7071481a9c75 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:21 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32eab605-bec3-453c-b09f-7a04f76e3dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507888961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2811ccfa-978d-4926-8325-291212cae805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:21Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 1073741824 Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132d075d-47d3-4ac0-99af-4662c050233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132d075d-47d3-4ac0-99af-4662c050233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10afe36b-5daa-4a32-926d-f0250ddf1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10afe36b-5daa-4a32-926d-f0250ddf1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2811ccfa-978d-4926-8325-291212cae805', 'volume_name': 'volume-2811ccfa-978d-4926-8325-291212cae805', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e393e66-eeae-4780-9c2e-bb6b317038e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e393e66-eeae-4780-9c2e-bb6b317038e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb640291-9bf1-4f32-995f-71ff2a2216ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:21 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Volume 2811ccfa-978d-4926-8325-291212cae805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2811ccfa-978d-4926-8325-291212cae805', 'volume_size': 1} Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:21 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:21 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 1073741824" returned: 0 in 0.425s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:22 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 Jul 29 16:25:22 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:22 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507888961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2811ccfa-978d-4926-8325-291212cae805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:21Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Creating volume 2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:22 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3e4b05-3f8b-486a-9472-5f0c3aa83ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cbe856-e5ec-4cea-bc94-7071481a9c75', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287ba332-dfd4-4b85-96a8-cf198b798923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:22 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 1073741824 Jul 29 16:25:22 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:22 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Volume volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 (68cbe856-e5ec-4cea-bc94-7071481a9c75): created successfully Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287ba332-dfd4-4b85-96a8-cf198b798923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (540d2ca0-9a71-4807-a999-7a43a81c246b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:22 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-71ef753a-0dc8-45bc-a0c3-76045467c064 tempest-ProjectReaderTests-978668240 None] Created volume successfully. Jul 29 16:25:22 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 1073741824" returned: 0 in 0.420s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:22 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 Jul 29 16:25:22 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:22 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:22 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb640291-9bf1-4f32-995f-71ff2a2216ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2811ccfa-978d-4926-8325-291212cae805', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13494203-d5d7-4c88-921b-810918f4303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:23 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Volume volume-2811ccfa-978d-4926-8325-291212cae805 (2811ccfa-978d-4926-8325-291212cae805): created successfully Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13494203-d5d7-4c88-921b-810918f4303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (4f690fd6-1c67-4a90-8b78-b06d69dd0054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:23 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-bde93576-9135-436f-8829-f70f6142e513 tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-68cbe856-e5ec-4cea-bc94-7071481a9c75-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Lock "cinder-68cbe856-e5ec-4cea-bc94-7071481a9c75-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-quobyte-68cbe856-e5ec-4cea-bc94-7071481a9c75" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-68cbe856-e5ec-4cea-bc94-7071481a9c75" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87b0169-c68c-4580-b27a-759516cec3d9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:23 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 Jul 29 16:25:23 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Creating offline snapshot fe7de27a-72aa-45ed-bff7-3655783d852e of volume 2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0366f7c5-9edf-4008-8261-58cf960d8c69]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:23 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 Jul 29 16:25:23 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:23 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75" returned: 0 in 0.406s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:23 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:23 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75 Jul 29 16:25:23 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:24 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805" returned: 0 in 0.378s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:24 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e 1G Jul 29 16:25:24 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:24 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-68cbe856-e5ec-4cea-bc94-7071481a9c75" returned: 0 in 0.258s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-68cbe856-e5ec-4cea-bc94-7071481a9c75" released by "delete_volume" :: held 0.706s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Created reservations ['4db8aea3-af78-4473-9e5b-9b2a8166cf82', 'f0a56545-e160-4e1e-8b72-2033db809b3e', '6c9b53b9-cb15-42fa-a30a-b4d16ad605c7', '0b837de1-2748-43cc-a763-df2d03aa0443'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:24 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:24 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:24 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e 1G" returned: 0 in 0.454s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2811ccfa-978d-4926-8325-291212cae805 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:24 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2811ccfa-978d-4926-8325-291212cae805 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e Jul 29 16:25:24 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:24 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.285s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:24 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Deleted volume successfully. Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5dc411cb-cd5a-4f38-b93f-466161461862 tempest-ProjectReaderTests-978668240 None] Lock "cinder-68cbe856-e5ec-4cea-bc94-7071481a9c75-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:24 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2811ccfa-978d-4926-8325-291212cae805 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e" returned: 0 in 0.363s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:24 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e is being set with open permissions: ugo+rw Jul 29 16:25:24 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:24 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e Jul 29 16:25:24 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (2fbd8164-e43a-4f5c-909c-64a720963d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8508976a-7538-4640-9efd-faf5669027e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8508976a-7538-4640-9efd-faf5669027e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569574299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae0fb94-a651-40f8-9e08-4cfe1f817d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:25Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99975391-a6b0-4733-a8b4-aba9cd1a6104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99975391-a6b0-4733-a8b4-aba9cd1a6104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0883ad-30c2-4698-90a6-1b4d508bc6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0883ad-30c2-4698-90a6-1b4d508bc6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae0fb94-a651-40f8-9e08-4cfe1f817d24', 'volume_name': 'volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ab4c91-54a7-4519-81b3-871bd46d1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ab4c91-54a7-4519-81b3-871bd46d1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b84c81-913b-438c-83b4-3714222bb7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:25 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Volume fae0fb94-a651-40f8-9e08-4cfe1f817d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24', 'volume_size': 1} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:25 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e" returned: 0 in 0.266s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:25 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info Jul 29 16:25:25 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:25 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:25 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info is being set with open permissions: ugo+rw Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:25 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info Jul 29 16:25:25 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:25 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.info" returned: 0 in 0.250s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569574299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae0fb94-a651-40f8-9e08-4cfe1f817d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7442bb0aad94459c8757c5cdaf4d1764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:25Z,use_quota=True,user_id='e2116010a63444cd8dcd028fca4c89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Creating volume fae0fb94-a651-40f8-9e08-4cfe1f817d24 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:25 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:25 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:25 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 1073741824 Jul 29 16:25:25 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:25 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-f11b0dd0-196a-44a1-87d9-10f3a5eff438 tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:25:26 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 1073741824" returned: 0 in 0.433s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:26 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 Jul 29 16:25:26 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:26 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24" returned: 0 in 0.241s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b84c81-913b-438c-83b4-3714222bb7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf868c2-6dd3-4f3c-af9d-4ff43cd8c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:26 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Volume volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 (fae0fb94-a651-40f8-9e08-4cfe1f817d24): created successfully Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf868c2-6dd3-4f3c-af9d-4ff43cd8c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Flow 'volume_create_manager' (2fbd8164-e43a-4f5c-909c-64a720963d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:26 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-77a3a2ae-b964-4ac6-816a-1cf0161ef6c3 tempest-ProjectReaderTests-978668240 None] Created volume successfully. Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-fe7de27a-72aa-45ed-bff7-3655783d852e-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Lock "cinder-fe7de27a-72aa-45ed-bff7-3655783d852e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-2811ccfa-978d-4926-8325-291212cae805" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-2811ccfa-978d-4926-8325-291212cae805" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-fe7de27a-72aa-45ed-bff7-3655783d852e" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-fe7de27a-72aa-45ed-bff7-3655783d852e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot fe7de27a-72aa-45ed-bff7-3655783d852e of volume 2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[903a6a31-4524-4e3a-bb4c-f8e1adbba8e7]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:26 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:26 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e Jul 29 16:25:26 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-fae0fb94-a651-40f8-9e08-4cfe1f817d24-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Lock "cinder-fae0fb94-a651-40f8-9e08-4cfe1f817d24-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Acquiring lock "cinder-quobyte-fae0fb94-a651-40f8-9e08-4cfe1f817d24" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-fae0fb94-a651-40f8-9e08-4cfe1f817d24" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5bc66f-df32-400c-acb7-873fa0d14bff]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:27 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e" returned: 0 in 0.403s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2811ccfa-978d-4926-8325-291212cae805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f6aa50-33e7-4a55-aac7-88dd45ec952f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:27 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 Jul 29 16:25:27 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:27 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 Jul 29 16:25:27 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:27 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24" returned: 0 in 0.402s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:27 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24 Jul 29 16:25:27 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:27 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805" returned: 0 in 0.407s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:27 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e Jul 29 16:25:27 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:27 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-fae0fb94-a651-40f8-9e08-4cfe1f817d24" returned: 0 in 0.271s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Lock "cinder-quobyte-fae0fb94-a651-40f8-9e08-4cfe1f817d24" released by "delete_volume" :: held 0.715s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:27 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Created reservations ['b75a29eb-c329-4b1b-86c5-cd70bb854e4a', '179160ec-9ea6-4ff3-a6cc-8b3cc9868a72', '40d91028-b7c6-4157-ba2d-b8f15b067b45', '69b88345-aa3e-4826-9c20-2ec0f724aec3'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:28 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e" returned: 0 in 0.380s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:28 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:28 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:28 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e Jul 29 16:25:28 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:28 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.296s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:28 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805.fe7de27a-72aa-45ed-bff7-3655783d852e" returned: 0 in 0.289s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Deleted volume successfully. Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-fe7de27a-72aa-45ed-bff7-3655783d852e" released by "_delete_snapshot" :: held 1.593s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-2811ccfa-978d-4926-8325-291212cae805" released by "delete_snapshot" :: held 1.617s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-056ef484-ecc4-44f0-8e83-8867c4ea72eb tempest-ProjectReaderTests-978668240 None] Lock "cinder-fae0fb94-a651-40f8-9e08-4cfe1f817d24-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Created reservations ['4a7c8353-a39f-425f-9774-86fcd78aa3c3', 'b61f1e42-14f4-4c2d-9351-4fa005d762d1', 'bd444a9e-8ec7-44bf-b619-a729616f8af4', 'c324074f-7146-438d-be0f-25cc1976cf79'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:28 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-3b4e5b78-91b8-4e53-8b96-f1fb0a70a004 tempest-ProjectMemberTests-345949226 None] Lock "cinder-fe7de27a-72aa-45ed-bff7-3655783d852e-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-2811ccfa-978d-4926-8325-291212cae805-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:28 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Lock "cinder-2811ccfa-978d-4926-8325-291212cae805-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-2811ccfa-978d-4926-8325-291212cae805" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-2811ccfa-978d-4926-8325-291212cae805" acquired by "delete_volume" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1019f1-b84a-4ccf-9184-c610fbfc727f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:29 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 Jul 29 16:25:29 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:29 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805" returned: 0 in 0.399s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:29 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805 Jul 29 16:25:29 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:29 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-2811ccfa-978d-4926-8325-291212cae805" returned: 0 in 0.259s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-2811ccfa-978d-4926-8325-291212cae805" released by "delete_volume" :: held 0.730s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Created reservations ['a6ba308a-3215-4d7f-820b-00ba29f4c8b2', 'd8355be6-64c6-4320-8c24-ba02a7ffc57e', 'a9a7f780-b95e-4321-a0c8-0c05322d642a', 'a84059cd-6590-4749-846b-77c370f464c0'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:29 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:29 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:29 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:30 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.293s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:30 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-2267d187-d625-4a0e-bf75-cd68dce68455 tempest-ProjectMemberTests-345949226 None] Lock "cinder-2811ccfa-978d-4926-8325-291212cae805-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (a6f6274d-8fda-4a26-996b-4328cb0ca0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f9054c-cffb-4fa0-9a4e-6c4765bfb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f9054c-cffb-4fa0-9a4e-6c4765bfb96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274583841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3694ed-9712-4451-abee-51445f35750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:31Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad11e51-661f-4769-96ec-f71ba84bb825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad11e51-661f-4769-96ec-f71ba84bb825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe205fab-3643-4bb7-af35-548bb9ded984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe205fab-3643-4bb7-af35-548bb9ded984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3694ed-9712-4451-abee-51445f35750a', 'volume_name': 'volume-be3694ed-9712-4451-abee-51445f35750a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dc04bd-22ea-49e8-97d6-160ff521b4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dc04bd-22ea-49e8-97d6-160ff521b4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13ea076-2afd-43bc-8e73-04f39487cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:30 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Volume be3694ed-9712-4451-abee-51445f35750a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3694ed-9712-4451-abee-51445f35750a', 'volume_size': 1} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274583841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3694ed-9712-4451-abee-51445f35750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:31Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Creating volume be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:30 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:30 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:30 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a 1073741824 Jul 29 16:25:30 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:31 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a 1073741824" returned: 0 in 0.431s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:31 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a Jul 29 16:25:31 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:31 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a" returned: 0 in 0.242s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13ea076-2afd-43bc-8e73-04f39487cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3694ed-9712-4451-abee-51445f35750a', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adf838a-569f-44e7-a5dd-ac8798262223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:31 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Volume volume-be3694ed-9712-4451-abee-51445f35750a (be3694ed-9712-4451-abee-51445f35750a): created successfully Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adf838a-569f-44e7-a5dd-ac8798262223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (a6f6274d-8fda-4a26-996b-4328cb0ca0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:31 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-4f54c876-5eae-4dd2-957c-42893f756366 tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Creating offline snapshot 4fc934dd-d0b6-4a0d-a209-63f489f97e1c of volume be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1848bc2-bb41-497d-8609-b135152b95c0]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:31 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:31 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a Jul 29 16:25:31 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:32 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a" returned: 0 in 0.358s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:32 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c 1G Jul 29 16:25:32 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:32 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c 1G" returned: 0 in 0.424s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3694ed-9712-4451-abee-51445f35750a -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:32 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3694ed-9712-4451-abee-51445f35750a -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c Jul 29 16:25:32 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:32 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3694ed-9712-4451-abee-51445f35750a -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c" returned: 0 in 0.330s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:32 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c is being set with open permissions: ugo+rw Jul 29 16:25:32 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:32 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c Jul 29 16:25:32 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:33 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:33 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info Jul 29 16:25:33 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:33 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info" returned: 0 in 0.247s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:33 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info is being set with open permissions: ugo+rw Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:33 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info Jul 29 16:25:33 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:33 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.info" returned: 0 in 0.255s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:33 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0575b664-e67d-47eb-a3a1-36840fc4053a tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-4fc934dd-d0b6-4a0d-a209-63f489f97e1c-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Lock "cinder-4fc934dd-d0b6-4a0d-a209-63f489f97e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-be3694ed-9712-4451-abee-51445f35750a" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-be3694ed-9712-4451-abee-51445f35750a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-4fc934dd-d0b6-4a0d-a209-63f489f97e1c" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-4fc934dd-d0b6-4a0d-a209-63f489f97e1c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot 4fc934dd-d0b6-4a0d-a209-63f489f97e1c of volume be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde903e1-de2c-41ac-86fc-78ba4bfe4581]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:33 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:34 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c Jul 29 16:25:34 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:34 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c" returned: 0 in 0.360s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:34 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3694ed-9712-4451-abee-51445f35750a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:25:34 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e77bc73-5bc5-469d-910b-cfcc30ee7744]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:34 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a Jul 29 16:25:34 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:34 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a" returned: 0 in 0.374s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:34 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:34 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c Jul 29 16:25:34 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:35 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c" returned: 0 in 0.348s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:35 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c Jul 29 16:25:35 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:35 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a.4fc934dd-d0b6-4a0d-a209-63f489f97e1c" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-4fc934dd-d0b6-4a0d-a209-63f489f97e1c" released by "_delete_snapshot" :: held 1.422s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-be3694ed-9712-4451-abee-51445f35750a" released by "delete_snapshot" :: held 1.443s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Created reservations ['08cf58af-7008-44de-ae47-efc55f85f96d', '2a9d1623-6921-4288-a8de-361032fbb19e', '05c8954b-0cea-468c-b0a5-2646a670e97e', 'bf94c494-1f7e-489c-aef3-d1ee46233bfc'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:35 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:35 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-744f2862-94d9-4693-b407-0b811243ab0e tempest-ProjectMemberTests-345949226 None] Lock "cinder-4fc934dd-d0b6-4a0d-a209-63f489f97e1c-delete_snapshot" released by "delete_snapshot" :: held 1.596s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-be3694ed-9712-4451-abee-51445f35750a-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Lock "cinder-be3694ed-9712-4451-abee-51445f35750a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-be3694ed-9712-4451-abee-51445f35750a" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-be3694ed-9712-4451-abee-51445f35750a" acquired by "delete_volume" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a198aa7-1483-4f59-a62d-d9e84b57b288]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:36 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a Jul 29 16:25:36 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:36 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a" returned: 0 in 0.352s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:36 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a Jul 29 16:25:36 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_service.periodic_task [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88575) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:36 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-be3694ed-9712-4451-abee-51445f35750a" returned: 0 in 0.262s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:36 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:36 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-be3694ed-9712-4451-abee-51445f35750a" released by "delete_volume" :: held 0.681s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Created reservations ['3672938b-6d0d-44b3-9e4c-7221c7d56548', '6e97fc15-1a4c-469a-987b-a685f9ae91d2', '8b08f8cc-6434-4d5b-8cbe-e93d9d8b6ac0', 'cd2b35d0-b0d9-4163-a001-e46a393e9975'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:36 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:36 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:36 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:37 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-5ef50dcb-d0de-42d6-a228-40369560542f None None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:37 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.273s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:37 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-07182ea6-2735-4d1d-8308-6fcc739c47ea tempest-ProjectMemberTests-345949226 None] Lock "cinder-be3694ed-9712-4451-abee-51445f35750a-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (ec48337a-ed61-4229-8504-79607337354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fdff34-e493-444b-9c32-a51488129797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fdff34-e493-444b-9c32-a51488129797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-984075013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4721a17-d6ec-4a21-b553-ea1ab09931c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:38Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdef1b9-0cae-435f-90ff-00abf4b916ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdef1b9-0cae-435f-90ff-00abf4b916ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e65c72-7cbf-4f5e-a214-f2e67ed6d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e65c72-7cbf-4f5e-a214-f2e67ed6d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4721a17-d6ec-4a21-b553-ea1ab09931c8', 'volume_name': 'volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae774c79-adee-498f-95df-9f4cc0ef237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae774c79-adee-498f-95df-9f4cc0ef237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d81ee0-dd0a-4939-9c62-2a6e8f0bda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:37 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Volume d4721a17-d6ec-4a21-b553-ea1ab09931c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8', 'volume_size': 1} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-984075013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4721a17-d6ec-4a21-b553-ea1ab09931c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:38Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Creating volume d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:37 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:37 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:37 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 1073741824 Jul 29 16:25:37 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:38 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 1073741824" returned: 0 in 0.430s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:38 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 Jul 29 16:25:38 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:38 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8" returned: 0 in 0.249s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d81ee0-dd0a-4939-9c62-2a6e8f0bda5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d545b0f-e0f1-4841-9f3c-dfa3dc64542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:38 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Volume volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 (d4721a17-d6ec-4a21-b553-ea1ab09931c8): created successfully Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d545b0f-e0f1-4841-9f3c-dfa3dc64542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (ec48337a-ed61-4229-8504-79607337354d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:38 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-9e7d9ff9-d870-42df-8a28-08c9c8f9eed2 tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Creating offline snapshot ac8878c5-dd49-4297-a286-802163d4fc64 of volume d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[456ed88a-8d63-40b3-a21f-a4701230b5ff]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:38 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:38 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 Jul 29 16:25:38 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:39 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8" returned: 0 in 0.376s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:39 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 1G Jul 29 16:25:39 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:39 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 1G" returned: 0 in 0.403s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:39 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 Jul 29 16:25:39 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:39 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64" returned: 0 in 0.295s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:39 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 is being set with open permissions: ugo+rw Jul 29 16:25:39 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:39 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 Jul 29 16:25:39 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:40 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64" returned: 0 in 0.246s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:40 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info Jul 29 16:25:40 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:40 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info" returned: 0 in 0.250s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:40 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info is being set with open permissions: ugo+rw Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:40 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info Jul 29 16:25:40 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:40 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.info" returned: 0 in 0.253s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:40 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-bf3c6b5b-42a7-4196-b636-25492f4b19c7 tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:25:40 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-ac8878c5-dd49-4297-a286-802163d4fc64-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Lock "cinder-ac8878c5-dd49-4297-a286-802163d4fc64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-d4721a17-d6ec-4a21-b553-ea1ab09931c8" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d4721a17-d6ec-4a21-b553-ea1ab09931c8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-ac8878c5-dd49-4297-a286-802163d4fc64" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-ac8878c5-dd49-4297-a286-802163d4fc64" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot ac8878c5-dd49-4297-a286-802163d4fc64 of volume d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc959eee-f456-4a0c-83da-10c657582ea9]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:41 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 Jul 29 16:25:41 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:41 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64" returned: 0 in 0.390s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5280c61-17cf-4b89-8a47-1d4db518238f]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:41 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 Jul 29 16:25:41 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:41 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8" returned: 0 in 0.355s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:41 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:41 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 Jul 29 16:25:41 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:42 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64" returned: 0 in 0.330s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:42 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64 Jul 29 16:25:42 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:42 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8.ac8878c5-dd49-4297-a286-802163d4fc64" returned: 0 in 0.246s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-ac8878c5-dd49-4297-a286-802163d4fc64" released by "_delete_snapshot" :: held 1.417s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d4721a17-d6ec-4a21-b553-ea1ab09931c8" released by "delete_snapshot" :: held 1.439s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Created reservations ['b0ac6487-09c8-4170-995b-dddad95ed73e', 'd5ccbb45-90a7-4e4b-82d6-58a3610f5dfd', '62da3d96-2c10-4176-a798-360d98880414', '8bcd3f06-5fcf-417d-99e7-ede905167268'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:42 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:42 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-5237b62d-3e82-434d-a652-804fba0836c9 tempest-ProjectMemberTests-345949226 None] Lock "cinder-ac8878c5-dd49-4297-a286-802163d4fc64-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-d4721a17-d6ec-4a21-b553-ea1ab09931c8-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Lock "cinder-d4721a17-d6ec-4a21-b553-ea1ab09931c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-d4721a17-d6ec-4a21-b553-ea1ab09931c8" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d4721a17-d6ec-4a21-b553-ea1ab09931c8" acquired by "delete_volume" :: waited 0.014s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[876044ad-9246-484f-89e7-f42a3b7271bb]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:43 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 Jul 29 16:25:43 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:43 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8" returned: 0 in 0.382s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:43 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8 Jul 29 16:25:43 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:43 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-d4721a17-d6ec-4a21-b553-ea1ab09931c8" returned: 0 in 0.277s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-d4721a17-d6ec-4a21-b553-ea1ab09931c8" released by "delete_volume" :: held 0.715s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:43 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Created reservations ['adfc6058-f254-4d3c-9ca2-dad40c301e8d', 'dca83c61-50ad-4f13-8198-7c896e787584', '21a74dd8-9b9c-4224-bbca-c936cae5d67f', '5a5b0cc4-5d81-4e70-a99b-c740132ce035'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:44 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:44 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:44 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:44 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-efc2327d-efff-479e-950f-94854f3f190f tempest-ProjectMemberTests-345949226 None] Lock "cinder-d4721a17-d6ec-4a21-b553-ea1ab09931c8-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88575) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (81db271c-cd39-45de-b1c8-6cd8e7f9305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c091c86-827b-4e67-97f1-a789f28541cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c091c86-827b-4e67-97f1-a789f28541cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535054394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fad251b-3f7c-41a4-8b9e-708bae36d70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:45Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd16119-58ad-4f74-8dbf-cb28f36c6c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd16119-58ad-4f74-8dbf-cb28f36c6c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23399f81-d943-4a2e-99e3-f06481e261d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23399f81-d943-4a2e-99e3-f06481e261d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fad251b-3f7c-41a4-8b9e-708bae36d70f', 'volume_name': 'volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d477d786-ea50-47e4-9bc1-3b57d4b88f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d477d786-ea50-47e4-9bc1-3b57d4b88f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbfcffa-84aa-4e44-94cf-500acfd91f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:44 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Volume 8fad251b-3f7c-41a4-8b9e-708bae36d70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f', 'volume_size': 1} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-29T14:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535054394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fad251b-3f7c-41a4-8b9e-708bae36d70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3132b529dfc46f4a2b1190a642fb3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-29T14:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-29T14:25:45Z,use_quota=True,user_id='095096e74d1e471ea41f4eb90a49f6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5be763f6-ef25-41d4-b3c3-f3e0ebd97157),volume_type_id=5be763f6-ef25-41d4-b3c3-f3e0ebd97157)}" {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Creating volume 8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Selected osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 as target Quobyte volume. {{(pid=88575) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 29 16:25:44 devstack cinder-volume[88575]: INFO cinder.volume.drivers.remotefs [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] casted to osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601 Jul 29 16:25:44 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f 1073741824 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:44 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f 1073741824 Jul 29 16:25:44 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:45 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f 1073741824" returned: 0 in 0.429s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:45 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f Jul 29 16:25:45 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:45 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f" returned: 0 in 0.256s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'} {{(pid=88575) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbfcffa-84aa-4e44-94cf-500acfd91f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f', 'volume_size': 1}' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751e3ecd-fd26-479e-96c4-5904693e3103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 29 16:25:45 devstack cinder-volume[88575]: INFO cinder.volume.flows.manager.create_volume [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Volume volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f (8fad251b-3f7c-41a4-8b9e-708bae36d70f): created successfully Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751e3ecd-fd26-479e-96c4-5904693e3103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88575) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Flow 'volume_create_manager' (81db271c-cd39-45de-b1c8-6cd8e7f9305b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88575) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 29 16:25:45 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0eec73ab-d7a8-4be7-a114-afc34b8ecafc tempest-ProjectMemberTests-345949226 None] Created volume successfully. Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Creating offline snapshot a0da51a1-8b21-475d-89ae-1f2b2624ec05 of volume 8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a15e7-fcb6-4126-8c5d-55e47f66269b]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:45 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:46 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f Jul 29 16:25:46 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:46 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f" returned: 0 in 0.370s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 1G {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:46 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 1G Jul 29 16:25:46 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:46 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 1G" returned: 0 in 0.405s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:46 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:46 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 Jul 29 16:25:46 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:47 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f -F qcow2 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05" returned: 0 in 0.296s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:47 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 is being set with open permissions: ugo+rw Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:47 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 Jul 29 16:25:47 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:47 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:47 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info Jul 29 16:25:47 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:47 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info" returned: 0 in 0.252s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:47 devstack cinder-volume[88575]: WARNING cinder.volume.drivers.remotefs [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info is being set with open permissions: ugo+rw Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:47 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info Jul 29 16:25:47 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:47 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.info" returned: 0 in 0.245s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:47 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:47 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-0955b97e-dd09-4067-a953-69b50ac28fba tempest-ProjectMemberTests-345949226 None] Create snapshot completed successfully Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-a0da51a1-8b21-475d-89ae-1f2b2624ec05-delete_snapshot" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Lock "cinder-a0da51a1-8b21-475d-89ae-1f2b2624ec05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-8fad251b-3f7c-41a4-8b9e-708bae36d70f" by "delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-8fad251b-3f7c-41a4-8b9e-708bae36d70f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-a0da51a1-8b21-475d-89ae-1f2b2624ec05" by "_delete_snapshot" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-a0da51a1-8b21-475d-89ae-1f2b2624ec05" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Deleting offline snapshot a0da51a1-8b21-475d-89ae-1f2b2624ec05 of volume 8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] snapshot_file for this snap is: volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 {{(pid=88575) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[754da1c4-6137-4773-94f4-d9f65fc852b6]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:48 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 Jul 29 16:25:48 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:48 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05" returned: 0 in 0.372s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.remotefs [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88575) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b2bedc-226e-48b1-b9ea-9125a4221f53]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:48 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:48 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f Jul 29 16:25:48 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:49 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f" returned: 0 in 0.358s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:49 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 Jul 29 16:25:49 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:49 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05" returned: 0 in 0.334s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:49 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05 Jul 29 16:25:49 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:49 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f.a0da51a1-8b21-475d-89ae-1f2b2624ec05" returned: 0 in 0.263s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-a0da51a1-8b21-475d-89ae-1f2b2624ec05" released by "_delete_snapshot" :: held 1.433s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-8fad251b-3f7c-41a4-8b9e-708bae36d70f" released by "delete_snapshot" :: held 1.458s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Created reservations ['19952f3a-ec75-418b-83c7-275704f96059', '614a7260-f565-4f6f-8e10-116918ee75f3', 'bcc37d72-cd75-4fc2-b3ce-6f17d44012b3', '1bfbf0d2-188f-4216-9e40-fb568696d3c7'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:49 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Delete snapshot completed successfully. Jul 29 16:25:49 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-fdaa5f52-535e-4aad-bf93-a464492f6b6c tempest-ProjectMemberTests-345949226 None] Lock "cinder-a0da51a1-8b21-475d-89ae-1f2b2624ec05-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-8fad251b-3f7c-41a4-8b9e-708bae36d70f-delete_volume" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Lock "cinder-8fad251b-3f7c-41a4-8b9e-708bae36d70f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Acquiring lock "cinder-quobyte-8fad251b-3f7c-41a4-8b9e-708bae36d70f" by "delete_volume" {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-8fad251b-3f7c-41a4-8b9e-708bae36d70f" acquired by "delete_volume" :: waited 0.022s {{(pid=88575) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61d00ef-27b8-4bdd-8df7-8f511030b1c2]: (4, 'qcow2') {{(pid=89603) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:50 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f Jul 29 16:25:50 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:50 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f" returned: 0 in 0.366s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:50 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:50 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f Jul 29 16:25:50 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:51 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51/volume-8fad251b-3f7c-41a4-8b9e-708bae36d70f" returned: 0 in 0.250s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Lock "cinder-quobyte-8fad251b-3f7c-41a4-8b9e-708bae36d70f" released by "delete_volume" :: held 0.676s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG cinder.quota [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Created reservations ['2b37d607-ac25-4dd2-bb50-710574fb0c73', 'c2dbd088-e83f-4a8e-a035-73f56eaf6f6f', '4a5c8a1e-2e16-4751-9692-c9ceb4232500', '3ab7eeaf-3854-49bd-b3ae-4c0c17bad95e'] {{(pid=88575) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601': None} {{(pid=88575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG cinder.volume.drivers.quobyte [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a635b7db-2c4b-4781-89b0-9adb7e6d9601'] {{(pid=88575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.lockutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 29 16:25:51 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51 Jul 29 16:25:51 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 29 16:25:51 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG oslo_concurrency.processutils [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb9e87f52fa3a69a54bb335006b4bd51" returned: 0 in 0.269s {{(pid=88575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG cinder.manager [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Notifying Schedulers of capabilities ... {{(pid=88575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 29 16:25:51 devstack cinder-volume[88575]: INFO cinder.volume.manager [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Deleted volume successfully. Jul 29 16:25:51 devstack cinder-volume[88575]: DEBUG cinder.coordination [None req-7442e2a2-f3ea-4017-b513-87d7fd32367d tempest-ProjectMemberTests-345949226 None] Lock "cinder-8fad251b-3f7c-41a4-8b9e-708bae36d70f-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88575) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 29 16:26:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:UPDATE=170,cinder:SELECT=134,cinder:INSERT=46,cinder:DELETE=18 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 29 16:26:01 devstack cinder-volume[88575]: DEBUG dbcounter [-] [88575] Writing DB stats cinder:SELECT=89,cinder:UPDATE=138,cinder:INSERT=31,cinder:DELETE=9 {{(pid=88575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}